Benchmark

non-incremental/QF_ABV/brummayerbiere/matrixmultcomm12.smt2 

This benchmark shows that matrix multiplicationis not commutative in general.
We try to show that A x B = B x A, which is generally not the case.
The matrices have 12 * 12 fields of bit-width 32,
and are respectively represented by a one-dimensional array.

Contributed by Robert Brummayer (robert.brummayer@gmail.com).
Benchmark
Size312292
Compressed Size43672
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 312284
Compressed Size43682
Max. Term Depth3485
Asserts 1
Declared Functions0
Declared Constants4
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1 not1 =2 let3467
bvnot1 bvadd3456 bvmul3312 select576
store3744

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default sat ✅ 374.37900 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 9.83399 —
CVC3-SMT-COMP-2011 default sat ✅ 9.13949 —
CVC3-SMT-COMP-2012 default sat ✅ 9.04766 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 3.77609 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.90890 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 118.20600 —
MathSAT5-SMT-COMP-2011 default sat ✅ 302.07100 —
MathSAT5-SMT-COMP-2012 default sat ✅ 320.56600 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 15.61680 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default sat ✅ 16.48220 —
Tiffany de Wintermonte TdW-SMT-COMP-2012 default sat ✅ 197.13100 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 211.24200 —
Z3-SMT-COMP-2011 default sat ✅ 204.53400 —
SMT-COMP 2014 0.29 (5/7) Boolector Boolector boolectord unknown ❌ 2399.12000 2400.08000
Boolector boolectorj unknown ❌ 2399.32000 2400.06000
CVC4 CVC4 f7118b2 default sat ✅ 1.08418 1.07484
Kleaver Kleaver-indie-more-typed kleaver_indie_1 unknown ❌ 0.09593 0.08699
Kleaver-indie-more-typed kleaver_portfolio unknown ❌ 0.11590 0.11398
MathSAT MathSAT-5.2.12-Main default sat ✅ 129.24000 129.29600
SONOLAR sonolar_smtcomp-2014 default sat ✅ 13.96410 13.96790
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 21.30880 21.30880
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 221.52100 221.59600
SMT-COMP 2015 Boolector Boolector SMT15 QF_AUFBV final boolector_qf_aufbv sat ✅ 162.59800 162.63200
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 1.08753 1.08483
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 1.00875 1.00585
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 115.71100 115.75700
Yices2 Yices default sat ✅ 20.35110 20.35490
Z3 z3 4.4.0 default sat ✅ 197.50000 197.57900
SMT-COMP 2016 Boolector Boolector boolector sat ✅ 150.64900 150.72400
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1.01841 1.01970
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 104.21600 104.28100
Yices2 Yices-2.4.2 default sat ✅ 21.14260 21.15190
Z3 z3-4.4.1 default sat ✅ 298.06600 298.14600
SMT-COMP 2017 0.20 (4/5) Boolector Boolector SMT17 final boolector sat ✅ 163.77600 163.72900
CVC4 CVC4-smtcomp2017-main default sat ✅ 1.04419 1.04326
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 110.34000 110.31500
Yices2 Yices2-Main default sat ✅ 20.70930 20.70730
Z3 z3-4.5.0 default unknown ❌ 600.01400 599.72000
SMT-COMP 2018 0.40 (3/5) Boolector Boolector_default unknown ❌ 1200.07000 1199.93000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.12685 1.12683
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 105.76900 105.75100
Yices2 Yices 2.6.0_default sat ✅ 17.44940 17.44650
Z3 z3-4.7.1_default sat ✅ 820.87600 820.73000
SMT-COMP 2022 0.20 (4/5) Bitwuzla Bitwuzla-wrapped_default sat ✅ 39.34000 39.33420
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 2.99991 2.99988
MathSAT MathSAT-5.6.8_default sat ✅ 218.35300 218.29900
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 23.33830 23.33550
Z3 z3-4.8.17_default unknown ❌ 1200.02000 1199.65000