Benchmark

non-incremental/QF_ABV/brummayerbiere/matrixmultcomm11.smt2 

This benchmark shows that matrix multiplicationis not commutative in general.
We try to show that A x B = B x A, which is generally not the case.
The matrices have 11 * 11 fields of bit-width 32,
and are respectively represented by a one-dimensional array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size240943
Compressed Size34845
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 240935
Compressed Size34830
Max. Term Depth2689
Asserts 1
Declared Functions0
Declared Constants4
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1 not1 =2 let2672
bvnot1 bvadd2662 bvmul2541 select484
store2904

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 1464.31000 —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default sat ✅ 244.22100 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 6.41739 —
CVC3-SMT-COMP-2011 default sat ✅ 5.88325 —
CVC3-SMT-COMP-2012 default sat ✅ 5.82557 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 2.44855 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.78340 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 84.90580 —
MathSAT5-SMT-COMP-2011 default sat ✅ 199.91900 —
MathSAT5-SMT-COMP-2012 default sat ✅ 308.82800 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 9.73147 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 173.64800 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 104.42700 —
Z3-SMT-COMP-2011 default sat ✅ 82.97250 —
SMT-COMP 2014 0.29 (5/7) Boolector Boolector boolectord unknown ❌ 2399.12000 2400.04000
Boolector boolectorj unknown ❌ 2399.12000 2400.04000
CVC4 CVC4 f7118b2 default sat ✅ 0.93665 0.92586
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.06837 0.06699
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.10158 0.09198
MathSAT MathSAT-5.2.12-Main default sat ✅ 90.69080 90.72020
SONOLAR sonolar_smtcomp-2014 default sat ✅ 9.81140 9.79251
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 15.74020 15.73460
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 99.62610 99.65290
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 127.75400 127.78200
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.93396 0.93186
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.87020 0.86687
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 91.44010 91.47910
Yices2 Yices default sat ✅ 15.13480 15.13970
Z3 z3 4.4.0 default sat ✅ 83.34140 83.38330
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 132.26200 132.30900
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.85596 0.85676
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 76.78280 76.82950
Yices2 Yices-2.4.2 default sat ✅ 15.63800 15.64670
Z3 z3-4.4.1 default sat ✅ 121.36900 121.42200
SMT-COMP 2017 Boolector Boolector SMT17 final boolector sat ✅ 121.71300 121.71100
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.87697 0.87669
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 83.40320 83.39320
Yices2 Yices2-Main default sat ✅ 15.36840 15.36650
Z3 z3-4.5.0 default sat ✅ 386.75700 386.58900
SMT-COMP 2018 0.20 (4/5) Boolector Boolector_default sat ✅ 121.92500 121.92900
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.95920 0.95943
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 63.70630 63.71000
Yices2 Yices 2.6.0_default sat ✅ 12.75700 12.75590
Z3 z3-4.7.1_default sat ✅ 191.60900 191.58700
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 30.15280 30.15140
Poolector-wrapped-sq_default sat ✅ 32.20490 127.06000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.96216 0.96250
Par4 Par4-wrapped-sq_default sat ✅ 1.12097 3.20000
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 15.98840 15.98810
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 222.20200 222.19900
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default sat ✅ 30.34360 30.34100
Boolector Boolector-wrapped-sq_default sat ✅ 29.92780 29.91380
CVC4 CVC4-sq-final_default sat ✅ 1.03408 1.03442
MathSAT MathSAT5_default.sh sat ✅ 149.69800 149.68400
Par4 Par4-wrapped-sq_default sat ✅ 1.09009 2.97000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 16.59620 16.59700
Z3 z3-4.8.8_default sat ✅ 90.47650 90.43960
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 282.15400 282.05900
Yices2 Yices 2.6.2 bug fix_default sat ✅ 17.05700 17.05640
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 16.91960 16.91500
Z3 z3-4.8.11_default sat ✅ 95.00370 94.98830
SMT-COMP 2023 0.20 (4/5) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.51630 0.51618
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 2.64649 2.64664
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 5.30211 14.88310
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 16.73320 16.73310
Z3-Owl z3-Owl-Final_default sat ✅ 407.79400 407.75700
z3-Owl-Final_default unknown ❌ 1200.07000 1199.69000
SMT-COMP 2024 0.25 (3/4) Bitwuzla Bitwuzla sat ✅ 0.54310 0.44322
cvc5 cvc5 sat ✅ 2.15624 2.05455
SMTInterpol SMTInterpol unknown ❌ 1201.72023 1216.00476
Yices2 Yices2 sat ✅ 11.12899 11.02890
SMT-COMP 2025 0.50 (3/6) Bitwuzla Bitwuzla sat ✅ 0.44029 0.32123
cvc5 cvc5 sat ✅ 0.84330 0.71315
SMTInterpol SMTInterpol unknown ❌ 265.88143 282.33124
Yices2 Yices2 sat ✅ 10.53155 10.41027
Z3 Z3-Owl-base unknown ❌ 1201.44110 1201.12124
Z3-Owl Z3-Owl unknown ❌ 1201.75383 1201.14449