Benchmark

non-incremental/QF_BV/mcm/115.smt2

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size304395
Compressed Size19376
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 304387
Compressed Size19386
Max. Term Depth12
Asserts 6
Declared Functions0
Declared Constants9
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite10 not1 or5
and1831 =1847 BitVec1 extract1
bvand3 bvor1 bvadd629 bvsub1201
bvult6 bvugt1258 bvshl7198 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.33 (6/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.00929
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 11.16240
abziz_portfolio_2011_solvers_2 default sat ✅ 8.47962
abziz_portfolio_2012_minfeatures default unknown ❌ 5.22171
abziz_portfolio_2012_solvers default unknown ❌ 5.21240
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ 5.19513
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00935
Boolector-SMT-COMP-2011 default unknown ❌ 0.00940
Boolector-SMT-COMP-2012 default unknown ❌ 0.00943
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.07554
CVC3-SMT-COMP-2011 default unknown ❌ 0.06507
CVC3-SMT-COMP-2012 default unknown ❌ 0.06620
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 8.42992
CVC4-SMT-EVAL-2013 default sat ✅ 26.18130
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 1.75912
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 27.11910
MathSAT5-SMT-COMP-2011 default sat ✅ 3.27197
MathSAT5-SMT-COMP-2012 default sat ✅ 3.44700
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 2.20167
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.00927
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00943
SONOLAR-SMT-COMP-2012 default sat ✅ 2.07188
STP STP2-SMT-COMP-2011 default unknown ❌ 0.00953
STP2-SMT-COMP-2012 default sat ✅ 3.41306
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.00938
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 6.29619
Z3-SMT-COMP-2011 default sat ✅ 5.85514
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 2.94052 2.94055
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 2.83313 5.47617
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 5.51804 10.87130
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 3.10113 3.10153
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.93000
STP stp-cryptominisat4 default sat ✅ 2.54832 2.54761
stp-cmsat4-v15 default sat ✅ 2.02002 2.01969
stp-cmsat4-mt-v15 default unknown ❌ 1.68443 1.68374
stp-minisat-v15 default sat ✅ 1.92666 1.92571
Yices2 Yices default sat ✅ 0.64086 0.63990
Z3 z3 4.4.0 default sat ✅ 6.97229 6.97494
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 0.07053 0.07039
ABC_glucose glucose unknown ❌ 0.07018 0.07010
Boolector Boolector boolector sat ✅ 4.97990 4.98314
Boolector preprop boolector sat ✅ 5.42958 5.43173
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 5.40368 10.64690
MapleSTP MapleSTP default sat ✅ 3.75404 3.75602
MapleSTP-mt default sat ✅ 4.52746 12.95190
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 3.59606 3.59926
MinkeyRink Minkeyrink 2016 default sat ✅ 9.09284 14.90800
Q3B Q3B default unknown ❌ 2400.03000 7203.08000
STP stp-cms-exp-2016 default sat ✅ 4.75218 4.75471
stp-cms-mt-2016 default sat ✅ 4.65824 13.47380
stp-cms-st-2016 default sat ✅ 3.92706 3.92951
stp-minisat-st-2016 default sat ✅ 3.41329 3.41522
Yices2 Yices-2.4.2 default sat ✅ 1.08575 2.12296
Z3 z3-4.4.1 default sat ✅ 6.63126 6.63687
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 2.71381 2.70869
Boolector SMT17 final boolector sat ✅ 2.71202 2.70498
CVC4 CVC4-smtcomp2017-main default sat ✅ 5.50926 10.83980
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.02132 3.02076
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.12313 3.16604
Q3B Q3B default unknown ❌ 1.83470 3.40470
STP stp_st default sat ✅ 3.91606 3.91632
stp_mt default sat ✅ 4.69590 12.93980
Yices2 Yices2-Main default sat ✅ 0.88253 0.88206
Z3 z3-4.5.0 default sat ✅ 6.65502 6.65442
SMT-COMP 2018 Boolector Boolector_default sat ✅ 4.72003 4.71937
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 3.23302 3.23328
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.33429 3.33495
MinkeyRink Minkeyrink MT_mt sat ✅ 1.76666 3.47573
Minkeyrink ST_st sat ✅ 1.85119 1.85121
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.01684 2.01674
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 2.34686 4.64504
STP-Riss-st-2018_riss-no-stderr sat ✅ 5.47779 5.47760
Yices2 Yices 2.6.0_default sat ✅ 0.68270 0.68265
Z3 z3-4.7.1_default sat ✅ 5.04030 5.03977
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 2.76164 2.76147
Poolector-wrapped-sq_default sat ✅ 2.20283 8.18242
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 6.48008 6.48002
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 3.29786 3.29810
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.59962 3.28323
MinkeyRink ST-wrapped-sq_default sat ✅ 1.36389 1.36390
Par4 Par4-wrapped-sq_default sat ✅ 1.59305 4.49000
STP STP-2019-wrapped-sq_default sat ✅ 2.25097 2.25124
stp-mergesat-fixed-wrapped-sq_default sat ✅ 21.09260 21.09160
stp-minisat-wrapped-sq_default sat ✅ 2.55147 2.55172
stp-mt-wrapped-sq_default sat ✅ 2.25209 3.83800
stp-portfolio-fixed-wrapped-sq_default sat ✅ 23.11780 25.54280
stp-riss-wrapped-sq_default unknown ❌ 1.61966 1.61979
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.48650 1.48644
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 1.73064 1.73052
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 7.15681 7.15647
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 89.17790 89.17350
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.88933 0.88931
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.72812 1.72816
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.94573 0.94572
Bitwuzla-wrapped_default sat ✅ 0.72094 0.72076
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 4.41081 4.41079
MathSAT MathSAT-5.6.8_default sat ✅ 3.14393 3.14395
STP STP 2022.4_default sat ✅ 1.79190 1.79181
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.28566 1.28539
Z3++BV z3++bv_0702_default sat ✅ 2.12649 2.12622
Z3 z3-4.8.17_default sat ✅ 5.04850 5.04990
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 3.48333 3.30054
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 2.96296 2.96089
STP STP 2022.4_default sat ✅ 2.49441 2.49426
STP 2022.4_default sat ✅ 2.48459 2.48429
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1266.16000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.00165 1.00151
Z3-Owl z3-Owl-Final_default sat ✅ 29.72350 29.72060
z3-Owl-Final_default sat ✅ 30.27790 30.27680