Benchmark

non-incremental/QF_ABV/stp/grep0095.stp.smt2

From Vijay Ganesh, see http://theory.stanford.edu/~vganesh/stp.html

Benchmark
Size	1102541
Compressed Size	63269
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1102533
Compressed Size	63274
Max. Term Depth	16823
Asserts	1
Declared Functions	0
Declared Constants	7
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

false	1	ite	16693	not	1	and	1
=	16692	let	118	concat	225	extract	265
bvnot	49	bvand	249	bvor	16828	bvxor	1
bvadd	483	bvsub	75	bvult	2	bvshl	128
bvlshr	174	select	192	store	310

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2007	0.50 (1/2)	Yices	Yices 1.0.10	unknown ❌	1800.80000	—
		Z3	Z3 0.1	sat ✅	63.70000	—
			Z3 0.1 (fixed BV)	sat ✅	62.90000	—
SMT-COMP 2008	0.33 (2/3)	Boolector	Boolector	sat ✅	14.00000	—
		CVC3	CVC3-1.5	unknown ❌	883.90000	—
		Z3	Z3 0.1	sat ✅	73.20000	—
			Z3.2	sat ✅	311.00000	—
SMT-COMP 2009	0.50 (2/4)	Boolector	Boolector	sat ✅	13.00000	—
			Boolector 1.2	sat ✅	44.10000	—
		CVC3	CVC3 2.0	unknown ❌	900.00000	—
		MathSAT	MathSAT 4.3	unknown ❌	144.90000	—
		Yices2	Yices 2 proto	sat ✅	15.50000	—
SMT-COMP 2010	0.50 (1/2)	Boolector	Boolector 1.2	sat ✅	47.70000	—
		CVC3	CVC3 2.3	unknown ❌	1200.10000	—
SMT-COMP 2012	0.25 (3/4)	Boolector	Boolector	sat ✅	55.70000	—
			Boolector 1.5.23-833	sat ✅	87.30000	—
		CVC3	CVC3 v2.4.2	unknown ❌	1.00000	—
			CVC4 1.0rc.3931	unknown ❌	1200.00000	—
			CVC4 1.0rc.3970	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	sat ✅	22.80000	—
		Tiffany de Wintermonte	Tiffany de Wintermonte & Sonolar	sat ✅	22.00000	—
SMT-COMP 2011	0.60 (2/5)	Boolector	Boolector 1.5.23-833	sat ✅	78.30000	—
		CVC3	CVC3 v2.4	unknown ❌	1200.30000	—
		MathSAT	MathSAT5	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	sat ✅	37.50000	—
		Z3	Z3	unknown ❌	1200.00000	—
SMT Evaluation 2013	0.29 (5/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	22.53790	—
			Boolector-SMT-COMP-2011 default	sat ✅	42.69950	—
			Boolector-SMT-COMP-2012 default	sat ✅	17.03820	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	—	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	52.67840	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	504.19200	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	462.39100	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	4.45771	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	35.08290	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	10.20180	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	13.47190	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	1462.18000	—
			Z3-SMT-COMP-2011 default	unknown ❌	—	—
SMT-COMP 2014	0.29 (5/7)	Boolector	Boolector boolectord	sat ✅	31.08390	31.08130
			Boolector boolectorj	sat ✅	50.40160	50.41130
		CVC4	CVC4 f7118b2 default	unknown ❌	2399.22000	2400.03000
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.17814	0.16897
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.21621	0.20597
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	54.96360	54.97460
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	7.30194	7.29289
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.53521	0.52692
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	1571.93000	1572.54000
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	6.96353	6.96394
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unknown ❌	2400.01000	2400.74000
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	137.45000	137.49800
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	56.84930	56.86240
		Yices2	Yices default	sat ✅	0.51480	0.51392
		Z3	z3 4.4.0 default	sat ✅	1375.11000	1375.68000
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	7.84742	7.85206
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	161.07700	136.51400
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	48.74690	48.77570
		Yices2	Yices-2.4.2 default	sat ✅	0.51543	0.51570
		Z3	z3-4.4.1 default	sat ✅	1460.35000	1461.10000
SMT-COMP 2017	0.20 (4/5)	Boolector	Boolector SMT17 final boolector	sat ✅	6.39129	6.39140
		CVC4	CVC4-smtcomp2017-main default	sat ✅	144.84500	123.85100
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	47.85330	47.85220
		Yices2	Yices2-Main default	sat ✅	0.51069	0.51017
		Z3	z3-4.5.0 default	unknown ❌	600.09900	600.03300
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	6.78396	6.78410
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	251.15600	184.31500
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	45.91420	45.91230
		Yices2	Yices 2.6.0_default	sat ✅	0.49453	0.49426
		Z3	z3-4.7.1_default	sat ✅	98.72730	98.71990
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	7.33397	7.33194
			Poolector-wrapped-sq_default	sat ✅	7.07807	27.53620
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	38.46420	38.46420
		Par4	Par4-wrapped-sq_default	sat ✅	0.52083	0.00793
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.53046	0.53045
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	81.24670	81.22010
SMT-COMP 2022	0.20 (4/5)	Bitwuzla	Bitwuzla-wrapped_default	sat ✅	4.73204	4.73164
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	33.58110	33.57150
		MathSAT	MathSAT-5.6.8_default	sat ✅	80.37790	80.36780
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.55104	0.55096
		Z3	z3-4.8.17_default	unknown ❌	1200.09000	1199.97000