Benchmark

non-incremental/QF_BV/Sage2/bench_14250.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	669484
Compressed Size	26903
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	669476
Compressed Size	26893
Max. Term Depth	510
Asserts	888
Declared Functions	0
Declared Constants	453
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	161	=	360
let	13966	extract	13	bvand	27	bvor	167
bvadd	6615	bvmul	2538	bvult	147	bvule	189
bvugt	65	bvuge	136	bvshl	176	bvlshr	53
zero_extend	4196

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	2.59983	2.59566
			Boolector SMT17 final boolector	sat ✅	32.82030	32.81780
		CVC4	CVC4-smtcomp2017-main default	sat ✅	17.60690	34.99620
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	103.80300	103.75500
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	11.86470	18.40000
		Q3B	Q3B default	unknown ❌	600.04200	1799.47000
		STP	stp_st default	sat ✅	68.58380	68.56650
			stp_mt default	sat ✅	14.44910	37.90750
		Yices2	Yices2-Main default	sat ✅	3.12410	3.12387
		Z3	z3-4.5.0 default	sat ✅	515.04300	291.87700
SMT-COMP 2018		Boolector	Boolector_default	sat ✅	2.94636	2.94610
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	14.47930	14.47870
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	59.72230	59.72060
		MinkeyRink	Minkeyrink MT_mt	sat ✅	4.36266	15.80160
			Minkeyrink ST_st	sat ✅	42.26080	42.25460
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	178.53200	178.51700
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	83.65290	325.29800
			STP-Riss-st-2018_riss-no-stderr	sat ✅	34.24610	34.24320
		Yices2	Yices 2.6.0_default	sat ✅	3.64061	3.64004
		Z3	z3-4.7.1_default	sat ✅	1063.16000	1062.99000
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	4.65460	4.65442
			Poolector-wrapped-sq_default	sat ✅	1.50977	5.59588
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	36.34070	36.33390
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	17.69870	17.69800
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	2.84188	9.74664
			MinkeyRink ST-wrapped-sq_default	sat ✅	3.19001	3.18993
		Par4	Par4-wrapped-sq_default	sat ✅	2.54457	7.44000
		STP	STP-2019-wrapped-sq_default	sat ✅	186.02000	186.00700
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	785.48000	785.44500
			stp-minisat-wrapped-sq_default	unknown ❌	2400.03000	2399.74000
			stp-mt-wrapped-sq_default	sat ✅	87.04830	336.87800
			stp-portfolio-fixed-wrapped-sq_default	unknown ❌	2400.02000	3421.82000
			stp-riss-wrapped-sq_default	unknown ❌	2.57671	2.56308
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	3.62236	3.62208
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	1.19092	1.19080
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	2.19865	2.19849
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.01000	2399.75000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.95140	0.95136
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	176.80600	176.76900
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	12.49360	12.48990
		MathSAT	mathsat-5.6.6_default	sat ✅	3.20402	3.20392
		STP	STP 2021.0_default	sat ✅	8.80007	24.52440
		Z3	z3-4.8.11_default	sat ✅	90.06880	90.05590
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	sat ✅	14.63780	14.63680
			Bitwuzla-wrapped_default	sat ✅	5.91207	5.91166
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	29.99180	29.98840
		MathSAT	MathSAT-5.6.8_default	sat ✅	57.91180	57.90650
		STP	STP 2022.4_default	sat ✅	18.16080	18.15890
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.92346	0.92343
		Z3++BV	z3++bv_0702_default	sat ✅	14.53350	14.53150
		Z3	z3-4.8.17_default	sat ✅	18.68650	18.68730
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	13.14286	13.03430
		cvc5	cvc5	sat ✅	6.51296	6.41033
		SMTInterpol	SMTInterpol	unknown ❌	1201.72364	1234.98682
		STP	STP	sat ✅	7.78795	7.68823
		Yices2	Yices2	sat ✅	0.94657	0.84692
		Z3alpha	Z3-alpha	sat ✅	32.59420	32.48666
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	7.24707	7.12756
			Bitwuzla-MachBV-base	sat ✅	3.86757	3.74747
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	3.87000	3.74708
		BVDecide	bv_decide	sat ✅	28.41711	28.24792
			bv_decide-nokernel	sat ✅	27.46494	27.31330
		cvc5	cvc5	sat ✅	8.80278	8.67843
		SMTInterpol	SMTInterpol	unknown ❌	1201.49768	1226.72200
		Yices2	Yices2	sat ✅	0.81900	0.70137
		Z3alpha	Z3-alpha	sat ✅	129.78230	516.30387
		Z3	Z3-alpha-base	sat ✅	77.51545	77.38361
			Z3-Owl-base	sat ✅	280.31164	280.16388
			z3siri-base	sat ✅	77.14373	77.00580
		Z3-Owl	Z3-Owl	unknown ❌	1201.76016	1201.09928