Benchmark

non-incremental/QF_BV/mcm/20.smt2

more info in 'N. P. Lopes, L. Aksoy, V. Manquinho, J. Monteiro.
 Optimally Solving the MCM Problem Using Pseudo-Boolean Satisfiability.
 Technical Report RT/43/2010, INESC-ID, Nov. 2010'.
Benchmark
Size122693
Compressed Size7292
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2013-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 122685
Compressed Size7304
Max. Term Depth12
Asserts 23
Declared Functions0
Declared Constants36
Declared Sorts 0
Defined Functions4
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

Bool3 ite10 not1 or22
and996 =1118 BitVec1 extract1
bvand3 bvor2 bvadd353 bvsub641
bvult24 bvugt708 bvshl3836 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 1.00 (0/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ 0.00915
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌
abziz_portfolio_2011_solvers_2 default unknown ❌
abziz_portfolio_2012_minfeatures default unknown ❌
abziz_portfolio_2012_solvers default unknown ❌
AbzizPortfolio-SMT-COMP-2012 default unknown ❌
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ 0.00891
Boolector-SMT-COMP-2011 default unknown ❌ 0.00944
Boolector-SMT-COMP-2012 default unknown ❌
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.02454
CVC3-SMT-COMP-2011 default unknown ❌ 0.01947
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌
MathSAT5-SMT-COMP-2011 default unknown ❌
MathSAT5-SMT-COMP-2012 default unknown ❌
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2010 default unknown ❌ 0.01421
SONOLAR-SMT-COMP-2011 default unknown ❌ 0.00890
SONOLAR-SMT-COMP-2012 default unknown ❌
STP STP2-SMT-COMP-2011 default unknown ❌
STP2-SMT-COMP-2012 default unknown ❌
simplifyingSTP-SMT-COMP-2010 default unknown ❌ 0.00906
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 418.04900 418.12400
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 338.68500 679.76700
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 702.71300 1410.35000
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1616.44000 1616.95000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.92000
STP stp-cryptominisat4 default sat ✅ 703.05800 703.31700
stp-cmsat4-v15 default sat ✅ 285.23100 285.29400
stp-cmsat4-mt-v15 default unknown ❌ 1.21002 1.20881
stp-minisat-v15 default sat ✅ 320.75900 320.81000
Yices2 Yices default sat ✅ 135.82800 135.86900
Z3 z3 4.4.0 default sat ✅ 270.27100 270.34800
SMT-COMP 2016 0.40 (6/10) ABC ABC_default default_abc unknown ❌ 0.06377 0.06361
ABC_glucose glucose unknown ❌ 0.06605 0.06599
Boolector Boolector boolector sat ✅ 338.62300 338.82100
Boolector preprop boolector sat ✅ 340.68600 340.87900
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 758.42900 1523.07000
MapleSTP MapleSTP default unknown ❌ 2400.02000 2401.57000
MapleSTP-mt default unknown ❌ 2400.04000 9536.86000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unknown ❌ 2400.09000 2401.35000
MinkeyRink Minkeyrink 2016 default sat ✅ 124.36100 476.07200
Q3B Q3B default unknown ❌ 2400.06000 7204.33000
STP stp-cms-exp-2016 default sat ✅ 818.45400 818.83100
stp-cms-mt-2016 default sat ✅ 242.14300 954.98800
stp-cms-st-2016 default sat ✅ 648.20600 648.63800
stp-minisat-st-2016 default sat ✅ 1894.79000 1895.89000
Yices2 Yices-2.4.2 default sat ✅ 408.70100 408.89500
Z3 z3-4.4.1 default sat ✅ 440.89000 441.11700
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.02000 599.98900
Boolector SMT17 final boolector sat ✅ 149.75500 149.73500
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.06700 1204.23000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.01700 599.89000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 192.61900 384.01000
Q3B Q3B default unknown ❌ 0.92996 1.82961
STP stp_st default sat ✅ 232.10400 232.07900
stp_mt default sat ✅ 22.13780 80.43880
Yices2 Yices2-Main default sat ✅ 288.37500 288.36900
Z3 z3-4.5.0 default sat ✅ 297.89000 297.83700
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 1039.12000 1039.06000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 241.36100 241.36800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.82000
MinkeyRink Minkeyrink MT_mt sat ✅ 48.44180 189.77900
Minkeyrink ST_st sat ✅ 815.20400 815.19100
STP STP-CMS-st-2018_default-no-stderr sat ✅ 388.67500 388.68500
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 160.58000 634.21100
STP-Riss-st-2018_riss-no-stderr sat ✅ 161.55800 161.55800
Yices2 Yices 2.6.0_default sat ✅ 469.14700 469.06900
Z3 z3-4.7.1_default sat ✅ 70.57650 70.55100
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 421.35400 421.30400
Poolector-wrapped-sq_default sat ✅ 151.28700 599.19000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 999.02000 998.93600
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 240.84300 240.81200
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 60.09070 236.21400
MinkeyRink ST-wrapped-sq_default sat ✅ 91.49800 91.49380
Par4 Par4-wrapped-sq_default sat ✅ 281.61500 844.52000
STP STP-2019-wrapped-sq_default sat ✅ 87.04150 87.02960
stp-mergesat-fixed-wrapped-sq_default sat ✅ 128.25300 128.17900
stp-minisat-wrapped-sq_default sat ✅ 376.24500 376.15200
stp-mt-wrapped-sq_default sat ✅ 347.66000 1376.42000
stp-portfolio-fixed-wrapped-sq_default sat ✅ 415.31800 681.41800
stp-riss-wrapped-sq_default unknown ❌ 1.50502 1.50518
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 434.28500 434.23700
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 71.56340 71.56430
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 163.39100 163.36000
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.96000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 107.32900 107.32700
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 825.94200 825.86100
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 43.49840 43.49070
Bitwuzla-wrapped_default sat ✅ 148.19000 148.16100
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 130.19300 130.17100
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.02000 1199.55000
STP STP 2022.4_default sat ✅ 46.97230 46.96970
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 137.87600 137.87600
Z3++BV z3++bv_0702_default sat ✅ 86.55890 86.55560
Z3 z3-4.8.17_default sat ✅ 361.70600 361.58900
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 16.11588 15.98503
Bitwuzla-MachBV-base sat ✅ 312.70826 312.51864
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 144.08221 143.93520
BVDecide bv_decide sat ✅ 398.57121 398.61446
bv_decide-nokernel sat ✅ 400.55706 400.54802
cvc5 cvc5 sat ✅ 73.58524 73.45257
SMTInterpol SMTInterpol unknown ❌ 1201.48839 1233.37441
Yices2 Yices2 sat ✅ 98.60074 98.46748
Z3alpha Z3-alpha sat ✅ 422.37944 1687.53758
Z3 Z3-alpha-base sat ✅ 167.17615 167.02129
Z3-Owl-base sat ✅ 683.45697 683.25637
z3siri-base sat ✅ 169.03376 168.90104
Z3-Owl Z3-Owl sat ✅ 48.77630 48.64492