Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_difret_functions_wp_csplit.optimize_subexps.il.wp.smt2

Ivan Jager <aij+nospam@andrew.cmu.edu>

Benchmark
Size	30922
Compressed Size	3558
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2011-06-30
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	30914
Compressed Size	3560
Max. Term Depth	133
Asserts	1
Declared Functions	0
Declared Constants	12
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	276	not	6	=	274	let	50
concat	106	extract	52	bvnot	25	bvand	52
bvor	96	bvxor	10	bvadd	89	bvsub	8
bvult	1	bvshl	204	bvlshr	100	sign_extend	2
select	98	store	40

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.14 (6/7)	Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	0.56475	—
			Boolector-SMT-COMP-2011 default	sat ✅	3.39897	—
			Boolector-SMT-COMP-2012 default	sat ✅	0.52034	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	163.73200	—
			CVC4-SMT-EVAL-2013 default	sat ✅	138.33900	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	1.06000	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	5.36814	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	9.99734	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	sat ✅	0.51970	—
			SONOLAR-SMT-COMP-2011 default	sat ✅	0.88005	—
			SONOLAR-SMT-COMP-2012 default	sat ✅	0.35052	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	sat ✅	2.69518	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	8.39818	—
			Z3-SMT-COMP-2011 default	sat ✅	13.45500	—
SMT-COMP 2014	0.14 (6/7)	Boolector	Boolector boolectord	sat ✅	1.02198	1.01284
			Boolector boolectorj	sat ✅	1.23840	1.22781
		CVC4	CVC4 f7118b2 default	sat ✅	1095.26000	1095.59000
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unknown ❌	0.05985	0.05099
			Kleaver-indie-more-typed kleaver_portfolio	unknown ❌	0.05174	0.06599
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.68798	0.67890
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	0.78917	0.77888
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.87539	0.86687
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	6.02015	6.01208
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	sat ✅	0.90507	0.90486
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	2079.66000	2080.37000
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	1.60477	1.60276
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	3.53103	3.53046
		Yices2	Yices default	sat ✅	1.16869	1.16782
		Z3	z3 4.4.0 default	sat ✅	6.28248	6.28504
SMT-COMP 2016		Boolector	Boolector boolector	sat ✅	0.99466	0.99527
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	2.34323	2.34147
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	1.50375	1.50278
		Yices2	Yices-2.4.2 default	sat ✅	1.08813	1.08871
		Z3	z3-4.4.1 default	sat ✅	2.91304	2.91678
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	sat ✅	1.35968	1.35888
		CVC4	CVC4-smtcomp2017-main default	sat ✅	1.29158	1.29067
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.70662	0.70696
		Yices2	Yices2-Main default	sat ✅	0.57674	0.56764
		Z3	z3-4.5.0 default	sat ✅	6.18078	6.17942
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	sat ✅	2.59644	2.59641
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	1.24547	1.24565
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.61223	0.61291
		Yices2	Yices 2.6.0_default	sat ✅	0.62441	0.62428
		Z3	z3-4.7.1_default	sat ✅	6.81600	6.81515
SMT-COMP 2020	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.56560	1.56541
		Boolector	Boolector-wrapped-sq_default	sat ✅	1.60699	1.60675
		CVC4	CVC4-sq-final_default	unknown ❌	1200.02000	1198.93000
		MathSAT	MathSAT5_default.sh	sat ✅	4.48462	8.88446
		Par4	Par4-wrapped-sq_default	sat ✅	0.87336	2.44000
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.71331	0.71320
		Z3	z3-4.8.8_default	sat ✅	7.24801	7.24693
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	3.34973	3.34943
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.70525	0.70520
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.70324	0.70316
		Z3	z3-4.8.11_default	sat ✅	3.53542	3.53527
SMT-COMP 2024	0.50 (2/4)	Bitwuzla	Bitwuzla	sat ✅	1.23697	1.13718
		cvc5	cvc5	unknown ❌	1201.72021	1201.09585
		SMTInterpol	SMTInterpol	unknown ❌	1201.71501	1252.77056
		Yices2	Yices2	sat ✅	1.08318	0.98368
SMT-COMP 2025	0.33 (4/6)	Bitwuzla	Bitwuzla	sat ✅	0.62251	0.50959
		cvc5	cvc5	unknown ❌	1201.76980	1201.04722
		SMTInterpol	SMTInterpol	unknown ❌	1201.47201	1232.78952
		Yices2	Yices2	sat ✅	0.58644	0.46794
		Z3	Z3-Owl-base	sat ✅	19.97105	19.84705
		Z3-Owl	Z3-Owl	sat ✅	3.95193	3.82708