Benchmark

non-incremental/QF_ABV/stp/testcase11.stp.smt2

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html

Benchmark
Size	70001379
Compressed Size	1232936
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	70001371
Compressed Size	1232923
Max. Term Depth	1943
Asserts	1
Declared Functions	0
Declared Constants	1033798
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	161	false	1	ite	2736	not	1398
and	1	=	1019204	let	1932	extract	2891
bvnot	8	bvand	87	bvor	26	bvxor	8
bvadd	1929	bvmul	1	bvsub	632	bvult	20
bvule	90	bvslt	130	bvsle	6	bvshl	104
bvlshr	22	select	2136	store	11479

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007		Yices	Yices 1.0.10	sat ✅	69.70000	—
		Z3	Z3 0.1	sat ✅	18.20000	—
			Z3 0.1 (fixed BV)	sat ✅	18.30000	—
SMT-COMP 2008	0.33 (2/3)	Boolector	Boolector	sat ✅	13.00000	—
		CVC3	CVC3-1.5	unknown ❌	496.40000	—
		Z3	Z3 0.1	sat ✅	18.30000	—
			Z3.2	sat ✅	18.90000	—
SMT-COMP 2010	0.50 (1/2)	Boolector	Boolector 1.2	sat ✅	13.90000	—
		CVC3	CVC3 2.3	unknown ❌	411.50000	—
SMT-COMP 2012		Boolector	Boolector	sat ✅	18.90000	—
			Boolector 1.5.23-833	sat ✅	20.50000	—
		CVC3	CVC3 v2.4.2	unknown ❌	379.80000	—
			CVC4 1.0rc.3931	sat ✅	80.20000	—
			CVC4 1.0rc.3970	sat ✅	81.40000	—
		SONOLAR	SONOLAR	sat ✅	667.80000	—
		Tiffany de Wintermonte	Tiffany de Wintermonte & Sonolar	sat ✅	13.70000	—
SMT-COMP 2011	0.80 (1/5)	Boolector	Boolector 1.5.23-833	sat ✅	20.50000	—
		CVC3	CVC3 v2.4	unknown ❌	359.10000	—
		MathSAT	MathSAT5	unknown ❌	1200.10000	—
		SONOLAR	SONOLAR	unknown ❌	57.10000	—
		Z3	Z3	unknown ❌	112.20000	—
SMT Evaluation 2013		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	10.06490	—
			Boolector-SMT-COMP-2011 default	sat ✅	12.01110	—
			Boolector-SMT-COMP-2012 default	sat ✅	10.50160	—
		CVC3	CVC3-SMT-COMP-2010 default	sat ✅	282.83600	—
			CVC3-SMT-COMP-2011 default	sat ✅	249.76300	—
			CVC3-SMT-COMP-2012 default	sat ✅	250.71100	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	81.34370	—
			CVC4-SMT-EVAL-2013 default	sat ✅	73.15520	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	25.90030	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	45.05940	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	33.63830	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	28.88680	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	154.34200	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	7.03627	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	14.32580	—
			Z3-SMT-COMP-2011 default	sat ✅	13.34660	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	sat ✅	20.15160	20.14690
			Boolector boolectorj	sat ✅	20.02060	20.01200
		CVC4	CVC4 f7118b2 default	sat ✅	95.72470	95.73140
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	11.41170	11.40730
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	12.90460	12.89900
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	31.59260	31.59620
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	37.56610	37.57030
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	4.15461	4.14737
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	17.61190	17.61430
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	21.28830	21.29580
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	145.31100	145.36800
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	154.30300	154.37700
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	27.02470	27.03690
		Yices2	Yices default	sat ✅	4.09690	4.09738
		Z3	z3 4.4.0 default	sat ✅	16.65210	16.66050
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	24.50910	24.52340
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	172.60500	153.55000
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	24.47920	24.49610
		Yices2	Yices-2.4.2 default	sat ✅	4.03343	4.03549
		Z3	z3-4.4.1 default	sat ✅	15.90430	15.91460
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	23.47560	23.47400
		CVC4	CVC4-smtcomp2017-main default	sat ✅	243.37100	222.73500
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	24.76180	24.76180
		Yices2	Yices2-Main default	sat ✅	3.87627	3.87581
		Z3	z3-4.5.0 default	sat ✅	16.93510	16.93460
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	23.22950	23.22640
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	226.01300	201.23100
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	23.85970	23.86140
		Yices2	Yices 2.6.0_default	sat ✅	4.08269	4.08227
		Z3	z3-4.7.1_default	sat ✅	17.29930	17.29750
SMT-COMP 2022		Bitwuzla	Bitwuzla-wrapped_default	sat ✅	22.76290	22.76150
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	172.97500	167.41400
		MathSAT	MathSAT-5.6.8_default	sat ✅	37.06530	37.06340
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	4.60497	4.60472
		Z3	z3-4.8.17_default	sat ✅	22.77900	22.77770
SMT-COMP 2024	0.25 (3/4)	Bitwuzla	Bitwuzla	sat ✅	31.35700	31.22999
		cvc5	cvc5	sat ✅	48.85148	48.74853
		SMTInterpol	SMTInterpol	unknown ❌	476.28814	1697.31705
		Yices2	Yices2	sat ✅	3.70048	3.59952