Benchmark

non-incremental/QF_ABV/stp/testcase9.stp.smt2

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html

Benchmark
Size	72993315
Compressed Size	4945180
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	72993307
Compressed Size	4945185
Max. Term Depth	40571
Asserts	1
Declared Functions	0
Declared Constants	750710
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1121	false	1	ite	50831	not	25064
and	1	=	408267	let	40557	extract	48988
bvnot	26	bvand	10470	bvor	758	bvxor	1177
bvadd	58211	bvmul	10	bvsub	5992	bvult	638
bvule	351	bvslt	25	bvsle	242	bvshl	5171
bvlshr	1174	select	48818	store	210991

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007	0.50 (1/2)	Yices	Yices 1.0.10	unknown ❌	105.80000	—
		Z3	Z3 0.1	sat ✅	34.30000	—
			Z3 0.1 (fixed BV)	sat ✅	34.40000	—
SMT-COMP 2008	0.33 (2/3)	Boolector	Boolector	sat ✅	14.10000	—
		CVC3	CVC3-1.5	unknown ❌	290.90000	—
		Z3	Z3 0.1	sat ✅	34.80000	—
			Z3.2	sat ✅	27.00000	—
SMT-COMP 2010	0.50 (1/2)	Boolector	Boolector 1.2	sat ✅	16.10000	—
		CVC3	CVC3 2.3	unknown ❌	100.00000	—
SMT-COMP 2012		Boolector	Boolector	sat ✅	17.80000	—
			Boolector 1.5.23-833	sat ✅	21.30000	—
		CVC3	CVC3 v2.4.2	unknown ❌	73.80000	—
			CVC4 1.0rc.3931	sat ✅	175.90000	—
			CVC4 1.0rc.3970	sat ✅	178.40000	—
		SONOLAR	SONOLAR	sat ✅	379.00000	—
		Tiffany de Wintermonte	Tiffany de Wintermonte & Sonolar	sat ✅	28.70000	—
SMT-COMP 2011	0.80 (1/5)	Boolector	Boolector 1.5.23-833	sat ✅	21.20000	—
		CVC3	CVC3 v2.4	unknown ❌	71.00000	—
		MathSAT	MathSAT5	unknown ❌	919.80000	—
		SONOLAR	SONOLAR	unknown ❌	55.30000	—
		Z3	Z3	unknown ❌	72.70000	—
SMT Evaluation 2013	0.14 (6/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	10.77700	—
			Boolector-SMT-COMP-2011 default	sat ✅	13.06610	—
			Boolector-SMT-COMP-2012 default	sat ✅	11.37120	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	161.01700	—
			CVC3-SMT-COMP-2011 default	sat ✅	783.94000	—
			CVC3-SMT-COMP-2012 default	sat ✅	817.34100	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	386.54500	—
			CVC4-SMT-EVAL-2013 default	sat ✅	337.48400	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unknown ❌	119.44700	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	22.85800	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	22.60320	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	14.26420	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	542.91500	—
			Z3-SMT-COMP-2011 default	sat ✅	517.39000	—
SMT-COMP 2014	0.29 (5/7)	Boolector	Boolector boolectord	sat ✅	86.98020	86.97280
			Boolector boolectorj	sat ✅	85.96340	85.97690
		CVC4	CVC4 f7118b2 default	sat ✅	105.76700	105.78900
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	10.52160	10.51640
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	11.86830	11.84820
		MathSAT	MathSAT-5.2.12-Main default	unknown ❌	2399.31000	2400.09000
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	28.95620	28.95760
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	3.91715	3.90941
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	691.47600	691.64000
SMT-COMP 2015	0.20 (4/5)	Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	47.62420	47.64280
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	69.31630	69.34350
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	151.92100	151.90600
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unknown ❌	2400.01000	2400.77000
		Yices2	Yices default	sat ✅	3.87825	3.87841
		Z3	z3 4.4.0 default	sat ✅	1108.07000	1108.52000
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	53.56930	53.60510
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	216.39500	199.88300
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	2326.94000	2328.35000
		Yices2	Yices-2.4.2 default	sat ✅	3.84795	3.85022
		Z3	z3-4.4.1 default	sat ✅	573.38300	573.71600
SMT-COMP 2017	0.40 (3/5)	Boolector	Boolector SMT17 final boolector	sat ✅	30.23340	30.22920
		CVC4	CVC4-smtcomp2017-main default	sat ✅	144.57300	128.95500
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unknown ❌	600.11000	599.68000
		Yices2	Yices2-Main default	sat ✅	3.79808	3.79808
		Z3	z3-4.5.0 default	unknown ❌	600.04700	599.95800
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	31.18400	31.17680
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	152.02300	139.21000
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	1200.01000	1199.93000
		Yices2	Yices 2.6.0_default	sat ✅	3.89252	3.89182
		Z3	z3-4.7.1_default	sat ✅	144.28600	144.28600
SMT-COMP 2021	0.33 (2/3)	MathSAT	mathsat-5.6.6_default	unknown ❌	1200.07000	1199.90000
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	4.25416	8.42415
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	4.26852	4.26867
		Z3	z3-4.8.11_default	sat ✅	40.98950	40.97590
SMT-COMP 2024	0.25 (3/4)	Bitwuzla	Bitwuzla	sat ✅	32.10214	32.00067
		cvc5	cvc5	sat ✅	132.27830	132.17294
		SMTInterpol	SMTInterpol	unknown ❌	1202.21930	1411.17897
		Yices2	Yices2	sat ✅	3.48792	3.38745