Benchmark

non-incremental/QF_BV/Sage2/bench_16435.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	1624965
Compressed Size	48106
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1624957
Compressed Size	48096
Max. Term Depth	5521
Asserts	412
Declared Functions	0
Declared Constants	2336
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	false	1	not	57	=	69
let	33557	extract	3	bvand	2	bvor	10
bvadd	12061	bvmul	268	bvudiv	7	bvult	58
bvule	109	bvugt	35	bvuge	135	bvsle	1
bvsgt	1	bvsge	4	bvshl	9039	bvlshr	47
bvashr	5	zero_extend	12057

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	2.93064	2.93051
			Boolector SMT17 final boolector	sat ✅	8.70399	8.70377
		CVC4	CVC4-smtcomp2017-main default	sat ✅	5.33009	9.91419
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	348.76600	348.65500
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	1.62617	1.64123
		Q3B	Q3B default	unknown ❌	600.04800	1206.88000
		STP	stp_st default	sat ✅	2.32590	2.32532
			stp_mt default	sat ✅	4.84650	13.67240
		Yices2	Yices2-Main default	sat ✅	0.64805	0.64646
		Z3	z3-4.5.0 default	sat ✅	13.12850	13.12630
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	2.69433	2.69434
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	10.46030	10.45900
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	314.26900	314.26500
		MinkeyRink	Minkeyrink MT_mt	sat ✅	1.21573	2.81938
			Minkeyrink ST_st	sat ✅	1.11285	1.11303
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	4.63256	4.62848
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	2.22593	7.08305
			STP-Riss-st-2018_riss-no-stderr	sat ✅	3.66259	3.66234
		Yices2	Yices 2.6.0_default	sat ✅	1.11844	1.11830
		Z3	z3-4.7.1_default	sat ✅	24.57730	24.57600
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	4.07512	4.07497
			Poolector-wrapped-sq_default	sat ✅	2.33050	8.81072
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	5.08532	10.06490
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	16.66680	16.66670
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	1.06559	1.89992
			MinkeyRink ST-wrapped-sq_default	sat ✅	1.27768	1.27770
		Par4	Par4-wrapped-sq_default	sat ✅	1.11429	3.20000
		STP	STP-2019-wrapped-sq_default	sat ✅	2.45969	2.45993
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	10.30990	10.30850
			stp-minisat-wrapped-sq_default	sat ✅	1.72050	1.72062
			stp-mt-wrapped-sq_default	sat ✅	2.58685	8.45277
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	10.49070	13.94420
			stp-riss-wrapped-sq_default	unknown ❌	0.58844	0.58865
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	1.06175	1.06173
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	2.91565	2.91547
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	6.36353	6.36348
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.09000	2399.81000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.96113	0.96100
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	17.56930	17.56710
SMT-COMP 2021	0.25 (3/4)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	3.81298	3.81156
		MathSAT	mathsat-5.6.6_default	unknown ❌	1200.02000	1199.69000
		STP	STP 2021.0_default	sat ✅	0.76023	1.75589
		Z3	z3-4.8.11_default	sat ✅	9.43217	9.42570
SMT-COMP 2022	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.09256	2.09240
			Bitwuzla-wrapped_default	sat ✅	4.36913	4.36892
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	18.90280	18.90180
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.02000	1199.74000
		STP	STP 2022.4_default	sat ✅	1.53370	1.53360
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	1.49265	1.49250
		Z3++BV	z3++bv_0702_default	sat ✅	8.26352	8.25421
		Z3	z3-4.8.17_default	sat ✅	17.53380	17.53470
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	1.96376	1.96347
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	13.88830	13.88850
		STP	STP 2022.4_default	sat ✅	1.43319	1.43326
			STP 2022.4_default	sat ✅	1.43252	1.43244
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	5.29562	14.54360
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	1.36327	1.36326
		Z3-Owl	z3-Owl-Final_default	sat ✅	51.06650	51.06480
			z3-Owl-Final_default	sat ✅	59.36100	59.35420
SMT-COMP 2025	0.11 (8/9)	Bitwuzla	Bitwuzla	sat ✅	2.18445	2.05479
			Bitwuzla-MachBV-base	sat ✅	2.17575	2.05196
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	2.22077	2.09268
		BVDecide	bv_decide	sat ✅	29.35039	29.18473
			bv_decide-nokernel	sat ✅	20.53366	20.39467
		cvc5	cvc5	sat ✅	12.09539	11.96810
		SMTInterpol	SMTInterpol	unknown ❌	71.17733	91.50223
		Yices2	Yices2	sat ✅	2.24837	2.12979
		Z3alpha	Z3-alpha	sat ✅	28.09509	92.17412
		Z3	Z3-alpha-base	sat ✅	18.82607	18.69595
			Z3-Owl-base	sat ✅	91.54011	91.39827
			z3siri-base	sat ✅	20.31150	20.18215
		Z3-Owl	Z3-Owl	sat ✅	29.84413	29.70966