Benchmark

non-incremental/QF_ABV/dwp_formulas/try5_small_difret_functions_wp_chgrp.i_ring_empty.il.wp.smt2

Ivan Jager <aij+nospam@andrew.cmu.edu>

Benchmark
Size	1472
Compressed Size	473
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2011-06-30
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	1464
Compressed Size	467
Max. Term Depth	14
Asserts	1
Declared Functions	0
Declared Constants	3
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	1	not	1	=	2	let	2
concat	8	extract	4	bvor	6	bvadd	13
bvsub	1	bvshl	6	bvlshr	3	select	8
store	4

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	unsat ✅	0.00971	—
			Boolector-SMT-COMP-2011 default	unsat ✅	0.04763	—
			Boolector-SMT-COMP-2012 default	unsat ✅	0.00973	—
		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.01637	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.01293	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.01389	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.01026	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.01077	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.01625	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.02456	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.01633	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unsat ✅	0.00980	—
			SONOLAR-SMT-COMP-2011 default	unsat ✅	0.01475	—
			SONOLAR-SMT-COMP-2012 default	unsat ✅	0.00968	—
		Tiffany de Wintermonte	TdW-SMT-COMP-2012 default	unsat ✅	0.01011	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.01095	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.01538	—
SMT-COMP 2014		Boolector	Boolector boolectord	unsat ✅	0.01333	0.00300
			Boolector boolectorj	unsat ✅	0.01739	0.00300
		CVC4	CVC4 f7118b2 default	unsat ✅	0.01649	0.00600
		Kleaver	Kleaver-indie-more-typed kleaver_indie_1	unsat ✅	0.01993	0.01100
			Kleaver-indie-more-typed kleaver_portfolio	unsat ✅	0.02145	0.01500
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.02078	0.01200
		SONOLAR	sonolar_smtcomp-2014 default	unsat ✅	0.01270	0.00200
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.01021	0.00100
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.01444	0.00600
SMT-COMP 2015		Boolector	Boolector SMT15 QF_AUFBV final boolector_qf_aufbv	unsat ✅	0.00829	0.00200
		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.00966	0.00800
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.01004	0.00800
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.02151	0.02099
		Yices2	Yices default	unsat ✅	0.00840	0.00100
		Z3	z3 4.4.0 default	unsat ✅	0.03003	0.02999
SMT-COMP 2016		Boolector	Boolector boolector	unsat ✅	0.01227	0.00300
		CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.01577	0.01187
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.01700	0.01807
		Yices2	Yices-2.4.2 default	unsat ✅	0.01246	0.00373
		Z3	z3-4.4.1 default	unsat ✅	0.02923	0.03035
SMT-COMP 2017		Boolector	Boolector SMT17 final boolector	unsat ✅	0.00769	0.00285
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.01265	0.01159
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.01693	0.01780
		Yices2	Yices2-Main default	unsat ✅	0.00950	0.00290
		Z3	z3-4.5.0 default	unsat ✅	0.03182	0.03031
SMT-COMP 2018	0.20 (4/5)	Boolector	Boolector_default	unsat ✅	0.01874	0.00303
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.01245	0.01261
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	0.01573	0.01674
		Yices2	Yices 2.6.0_default	unsat ✅	0.00721	0.00575
		Z3	z3-4.7.1_default	unsat ✅	0.03403	0.03393
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.01024	0.00720
			Poolector-wrapped-sq_default	unsat ✅	0.17826	0.11769
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.01770	0.01805
		Par4	Par4-wrapped-sq_default	unsat ✅	0.01781	0.00587
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.00905	0.00559
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.03743	0.03740
SMT-COMP 2024		Bitwuzla	Bitwuzla	unsat ✅	0.21737	0.11768
		cvc5	cvc5	unsat ✅	0.22941	0.12981
		SMTInterpol	SMTInterpol	unsat ✅	175.27300	203.25190
		Yices2	Yices2	unsat ✅	0.21274	0.11292
SMT-COMP 2025		Bitwuzla	Bitwuzla	unsat ✅	0.25581	0.13594
		cvc5	cvc5	unsat ✅	0.30664	0.18088
		SMTInterpol	SMTInterpol	unsat ✅	148.81623	172.89900
		Yices2	Yices2	unsat ✅	0.26984	0.14858
		Z3	Z3-Owl-base	unsat ✅	0.26310	0.14727
		Z3-Owl	Z3-Owl	unsat ✅	0.81213	0.69022