Benchmark

non-incremental/QF_BV/galois/iffyInterleavedModMult-4.smt2

John Matthews (matthews@galois.com)
Levent Erkok  (levent.erkok@galois.com)

This directory contains benchmark equivalence checking formulas in the
SMT-Lib format. The benchmarks are checking whether an algorithm for
computing modular multiplication by interleaving the multiplication and
residue calculations, is equivalent to an algorithm that first multiplies
the two inputs, and then performs the residue calculation on the result.

Benchmark
Size	8594
Compressed Size	1570
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2013-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	8586
Compressed Size	1552
Max. Term Depth	7
Asserts	101
Declared Functions	0
Declared Constants	103
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	36	not	3	and	3	=>	1
=	128	let	1	concat	6	extract	30
bvnot	1	bvand	1	bvadd	3	bvmul	1
bvurem	1	bvsub	12	bvult	14	zero_extend	9

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.11 (8/9)	4Simp	4Simp-SMT-COMP-2012 default	unsat ✅	0.11516	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unsat ✅	0.13912	—
			abziz_portfolio_2011_solvers_2 default	unsat ✅	0.15292	—
			abziz_portfolio_2012_minfeatures default	unknown ❌	—	—
			abziz_portfolio_2012_solvers default	unsat ✅	0.13869	—
			AbzizPortfolio-SMT-COMP-2012 default	unsat ✅	0.15865	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.41997	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.28051	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.31091	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	454.24700	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.28815	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.33748	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.40280	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	unsat ✅	0.19989	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.47292	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.11354	—
			SONOLAR-SMT-COMP-2010 default	unsat ✅	0.62644	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	0.11229	—
		STP	STP2-SMT-COMP-2011 default	unsat ✅	0.09697	—
			STP2-SMT-COMP-2012 default	unsat ✅	0.10855	—
			simplifyingSTP-SMT-COMP-2010 default	unsat ✅	0.16945	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.15649	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.13371	—
SMT-COMP 2014		4Simp	4Simp - 2014 default	unsat ✅	0.07891	0.07599
		Abziz	abziz_portfolio_all_features default	unsat ✅	0.30332	0.29096
			abziz_portfolio_min_features default	unsat ✅	0.30661	0.29296
		Boolector	Boolector boolector	unsat ✅	0.34406	0.33395
		CVC4	CVC4 f7118b2 default	unsat ✅	0.27696	0.51892
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.36876	0.36694
		SONOLAR	sonolar_smtcomp-2014 default	unsat ✅	0.15911	0.14698
		STP	stp-cryptominisat4 default	unsat ✅	0.18403	0.16997
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.14598	0.13498
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.16641	0.15398
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.22404	0.22330
			Boolector SMT17 final boolector	unsat ✅	0.38135	0.38140
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.35212	0.68678
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.27384	0.27426
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.24659	0.22999
		Q3B	Q3B default	unsat ✅	0.55523	0.91000
		STP	stp_st default	unsat ✅	0.18284	0.18211
			stp_mt default	unsat ✅	0.26106	0.56787
		Yices2	Yices2-Main default	unsat ✅	0.12872	0.12783
		Z3	z3-4.5.0 default	unsat ✅	0.16464	0.16415
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.22199	0.22195
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.24484	0.24501
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.25354	0.25461
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.17529	0.55823
			Minkeyrink ST_st	unsat ✅	0.16712	0.16712
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.16696	0.16712
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.16005	0.53910
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.15740	0.15749
		Yices2	Yices 2.6.0_default	unsat ✅	0.12277	0.12266
		Z3	z3-4.7.1_default	unsat ✅	0.20722	0.20711