Benchmark

non-incremental/QF_BV/Sage2/bench_11027.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	41611
Compressed Size	5777
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	41603
Compressed Size	5803
Max. Term Depth	259
Asserts	163
Declared Functions	0
Declared Constants	141
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	7	not	92	=	155
let	741	bvor	17	bvadd	139	bvmul	139
bvule	4	bvslt	1	bvsle	1	bvsgt	8
bvshl	24	zero_extend	296	sign_extend	20

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	0.01023	0.00976
			Boolector SMT17 final boolector	sat ✅	0.00883	0.00913
		CVC4	CVC4-smtcomp2017-main default	sat ✅	3.56144	7.08787
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.94904	0.94869
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	2.76675	2.78754
		Q3B	Q3B default	unknown ❌	600.10800	1799.75000
		STP	stp_st default	sat ✅	2.18210	2.18179
			stp_mt default	sat ✅	2.04497	6.69118
		Yices2	Yices2-Main default	sat ✅	0.04873	0.04804
		Z3	z3-4.5.0 default	sat ✅	180.44700	180.39300
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	0.01130	0.00862
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	5.10373	5.10288
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	0.91433	0.91540
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.41676	0.56446
			Minkeyrink ST_st	sat ✅	0.38894	0.38912
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	0.46156	0.46163
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	0.49132	0.69740
			STP-Riss-st-2018_riss-no-stderr	sat ✅	1.47167	1.47157
		Yices2	Yices 2.6.0_default	sat ✅	0.04684	0.04678
		Z3	z3-4.7.1_default	sat ✅	28.87790	28.87590
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	0.01482	0.01485
			Poolector-wrapped-sq_default	sat ✅	0.17729	0.15961
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	145.19200	145.18000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	1.05937	1.05950
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.39632	0.52262
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.35825	0.35830
		Par4	Par4-wrapped-sq_default	sat ✅	0.01679	0.00562
		STP	STP-2019-wrapped-sq_default	sat ✅	0.46327	0.46356
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	7.82737	7.82680
			stp-minisat-wrapped-sq_default	sat ✅	0.58779	0.58797
			stp-mt-wrapped-sq_default	sat ✅	0.50061	0.64412
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	11.57590	8.17665
			stp-riss-wrapped-sq_default	unknown ❌	0.44438	0.44452
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.05143	0.05142
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.51510	1.51505
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	13.01370	13.01280
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	0.02806	0.02810
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.15189	0.15193
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	34.64350	34.62600
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.19485	0.19482
		MathSAT	mathsat-5.6.6_default	sat ✅	0.26874	0.26871
		STP	STP 2021.0_default	sat ✅	0.35693	0.46664
		Z3	z3-4.8.11_default	sat ✅	4.78072	4.78030
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.72729	0.72715
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	1.41137	1.41173
		STP	STP 2022.4_default	sat ✅	0.34255	0.34261
			STP 2022.4_default	sat ✅	0.34169	0.34170
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.05000	1246.40000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.09170	0.09038
		Z3-Owl	z3-Owl-Final_default	sat ✅	27.16240	27.15850
			z3-Owl-Final_default	sat ✅	25.37990	25.37890
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	0.47452	0.37445
		cvc5	cvc5	sat ✅	1.02846	0.92857
		SMTInterpol	SMTInterpol	unknown ❌	1201.77064	1228.62687
		STP	STP	sat ✅	0.51149	0.41162
		Yices2	Yices2	sat ✅	0.24724	0.14744
		Z3alpha	Z3-alpha	sat ✅	2.65227	2.55064
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	0.40295	0.26698
			Bitwuzla-MachBV-base	sat ✅	0.44394	0.31883
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	0.50486	0.37667
		BVDecide	bv_decide	sat ✅	1.97303	1.80911
			bv_decide-nokernel	sat ✅	1.97844	1.80991
		cvc5	cvc5	sat ✅	0.79600	0.67702
		SMTInterpol	SMTInterpol	unknown ❌	1201.79164	1232.78024
		Yices2	Yices2	sat ✅	0.28156	0.16250
		Z3alpha	Z3-alpha	sat ✅	2.57195	8.87292
		Z3	Z3-alpha-base	sat ✅	201.21675	201.05681
			Z3-Owl-base	sat ✅	878.65400	878.49740
			z3siri-base	sat ✅	203.42711	203.25098
		Z3-Owl	Z3-Owl	sat ✅	14.22104	14.08844