Benchmark

non-incremental/QF_BV/Sage2/bench_9664.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	1442573
Compressed Size	14233
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	1442565
Compressed Size	14224
Max. Term Depth	1049
Asserts	305
Declared Functions	0
Declared Constants	344
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	100	=	107	let	32735
bvand	15	bvadd	21450	bvmul	36	bvult	44
bvule	41	bvugt	19	bvuge	93	bvlshr	48
zero_extend	11086

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.38 (5/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unknown ❌	600.01700	599.84700
			Boolector SMT17 final boolector	unknown ❌	600.05300	599.95000
		CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.18100	1207.08000
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	5.91752	5.91702
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	0.32525	0.31185
		Q3B	Q3B default	unknown ❌	600.07900	1799.70000
		STP	stp_st default	sat ✅	0.66597	0.66513
			stp_mt default	sat ✅	0.84720	1.68783
		Yices2	Yices2-Main default	sat ✅	0.22977	0.22093
		Z3	z3-4.5.0 default	sat ✅	0.98114	1.88068
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	2.95445	2.95434
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	30.63590	30.63630
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	5.56209	5.56298
		MinkeyRink	Minkeyrink MT_mt	sat ✅	0.28234	0.29672
			Minkeyrink ST_st	sat ✅	0.27675	0.27697
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	0.34303	0.34306
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	0.37363	0.51475
			STP-Riss-st-2018_riss-no-stderr	sat ✅	0.90635	0.90644
		Yices2	Yices 2.6.0_default	sat ✅	0.22907	0.22899
		Z3	z3-4.7.1_default	sat ✅	1.15973	1.15969
SMT-COMP 2019	0.12 (7/8)	Boolector	Boolector-wrapped-sq_default	sat ✅	5.66761	5.66759
			Poolector-wrapped-sq_default	sat ✅	6.33717	24.77000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unknown ❌	2400.02000	2399.80000
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	9.32769	9.32439
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	0.42040	0.42856
			MinkeyRink ST-wrapped-sq_default	sat ✅	0.41407	0.41414
		Par4	Par4-wrapped-sq_default	sat ✅	0.24031	0.00596
		STP	STP-2019-wrapped-sq_default	sat ✅	0.35143	0.35174
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	5.03743	5.03751
			stp-minisat-wrapped-sq_default	sat ✅	0.38869	0.38886
			stp-mt-wrapped-sq_default	sat ✅	0.37379	0.50584
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	5.07662	5.26123
			stp-riss-wrapped-sq_default	unknown ❌	0.32016	0.32020
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.20064	0.20063
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	0.20770	0.20771
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	0.23371	0.23374
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	36.61910	36.61640
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.21252	0.21251
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	1.09676	1.09677
SMT-COMP 2023		Bitwuzla	Bitwuzla-fixed_default	sat ✅	2.48842	2.48820
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	5.12628	5.12681
		STP	STP 2022.4_default	sat ✅	0.19152	0.19158
			STP 2022.4_default	sat ✅	0.19237	0.19237
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	sat ✅	12.21810	33.78980
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.23217	0.23214
		Z3-Owl	z3-Owl-Final_default	unknown ❌	1200.11000	1199.89000
			z3-Owl-Final_default	sat ✅	304.11000	304.03400
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	0.58290	0.46242
			Bitwuzla-MachBV-base	sat ✅	0.65235	0.52576
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	0.73535	0.60878
		BVDecide	bv_decide	sat ✅	27.99668	27.85793
			bv_decide-nokernel	sat ✅	28.02377	27.90180
		cvc5	cvc5	sat ✅	41.49029	41.36062
		SMTInterpol	SMTInterpol	sat ✅	15.52647	35.99479
		Yices2	Yices2	sat ✅	0.39149	0.27209
		Z3alpha	Z3-alpha	sat ✅	8.10975	30.02928
		Z3	Z3-alpha-base	unknown ❌	1201.37124	1201.05320
			Z3-Owl-base	unknown ❌	1201.34679	1201.06798
			z3siri-base	unknown ❌	1201.34599	1201.11614
		Z3-Owl	Z3-Owl	unknown ❌	1201.76103	1201.18799