Benchmark

non-incremental/QF_ABV/stp/cmu-model15.smt2

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html

Benchmark
Size	591156
Compressed Size	72080
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	591148
Compressed Size	72085
Max. Term Depth	55
Asserts	1
Declared Functions	0
Declared Constants	6672
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	1	ite	340	not	1	and	1
=	6958	let	47	concat	848	extract	347
bvnot	74	bvand	604	bvor	453	bvxor	765
bvadd	771	bvsub	56	bvult	52	bvshl	380
bvlshr	628	select	550	store	204

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007	0.50 (1/2)	Yices	Yices 1.0.10	unknown ❌	1801.00000	—
		Z3	Z3 0.1	sat ✅	0.70000	—
			Z3 0.1 (fixed BV)	sat ✅	0.70000	—
SMT-COMP 2008	0.33 (2/3)	Boolector	Boolector	sat ✅	0.30000	—
		CVC3	CVC3-1.5	unknown ❌	805.50000	—
		Z3	Z3 0.1	sat ✅	0.70000	—
			Z3.2	sat ✅	1.10000	—
SMT-COMP 2010	0.50 (1/2)	Boolector	Boolector 1.2	sat ✅	0.40000	—
		CVC3	CVC3 2.3	unknown ❌	777.70000	—
SMT-COMP 2012		Boolector	Boolector	sat ✅	0.40000	—
			Boolector 1.5.23-833	sat ✅	0.70000	—
		CVC3	CVC3 v2.4.2	unknown ❌	357.10000	—
			CVC4 1.0rc.3931	unsat ✅	8.80000	—
			CVC4 1.0rc.3970	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	sat ✅	1.30000	—
		Tiffany de Wintermonte	Tiffany de Wintermonte & Sonolar	sat ✅	1.40000	—
SMT-COMP 2011	0.60 (2/5)	Boolector	Boolector 1.5.23-833	sat ✅	0.70000	—
		CVC3	CVC3 v2.4	unknown ❌	279.20000	—
		MathSAT	MathSAT5	sat ✅	427.10000	—
		SONOLAR	SONOLAR	unknown ❌	20.80000	—
		Z3	Z3	unknown ❌	1200.00000	—
SMT Evaluation 2013	0.14 (6/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	0.20383	—
			Boolector-SMT-COMP-2011 default	sat ✅	0.45607	—
			Boolector-SMT-COMP-2012 default	sat ✅	0.21271	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	448.20200	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	1.95479	—
			CVC4-SMT-EVAL-2013 default	sat ✅	1.46699	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.32304	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.78427	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.70498	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.33532	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.47476	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	0.52922	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.36538	—
			Z3-SMT-COMP-2011 default	sat ✅	0.63645	—
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.21893	0.21797
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	7.03852	7.03893
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	7.06564	7.06492
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.31504	0.31395
		Yices2	Yices default	sat ✅	0.07930	0.07799
		Z3	z3 4.4.0 default	sat ✅	0.30554	0.30595
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.34393	0.34408
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	6.67598	6.68013
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.26733	0.26847
		Yices2	Yices-2.4.2 default	sat ✅	0.07902	0.07904
		Z3	z3-4.4.1 default	sat ✅	0.31277	0.31406
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	0.28912	0.28871
		CVC4	CVC4-smtcomp2017-main default	sat ✅	6.65912	6.65932
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.27918	0.27547
		Yices2	Yices2-Main default	sat ✅	0.07933	0.07894
		Z3	z3-4.5.0 default	sat ✅	0.35378	0.35372
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	0.37008	0.37002
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	8.67141	8.67177
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.26889	0.26975
		Yices2	Yices 2.6.0_default	sat ✅	0.07542	0.07535
		Z3	z3-4.7.1_default	sat ✅	0.32065	0.32050
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.25017	0.23941
			Poolector-wrapped-sq_default	sat ✅	0.48020	1.01225
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	8.54184	8.54093
		Par4	Par4-wrapped-sq_default	sat ✅	0.08814	0.00791
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.07650	0.07645
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.33988	0.33984
SMT-COMP 2022	0.20 (4/5)	Bitwuzla	Bitwuzla-wrapped_default	sat ✅	0.27452	0.27433
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unknown ❌	1200.02000	1193.28000
		MathSAT	MathSAT-5.6.8_default	sat ✅	0.32830	0.32824
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.08621	0.08616
		Z3	z3-4.8.17_default	sat ✅	0.35166	0.35352
SMT-COMP 2024	0.25 (3/4)	Bitwuzla	Bitwuzla	sat ✅	0.57564	0.47563
		cvc5	cvc5	sat ✅	8.09184	7.98681
		SMTInterpol	SMTInterpol	unknown ❌	1202.26630	1266.37390
		Yices2	Yices2	sat ✅	0.30711	0.20722