Benchmark

non-incremental/QF_BV/Sage2/bench_15918.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	448670
Compressed Size	13110
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	448662
Compressed Size	13101
Max. Term Depth	160
Asserts	347
Declared Functions	0
Declared Constants	228
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	61	=	67	let	9709
extract	3	bvand	2	bvor	2	bvadd	3361
bvmul	237	bvult	50	bvule	67	bvugt	6
bvuge	152	bvsle	1	bvsgt	1	bvsge	2
bvshl	2576	bvlshr	30	bvashr	4	zero_extend	3433

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	1.41023	1.40764
			Boolector SMT17 final boolector	unsat ✅	5.67121	5.67062
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	187.54700	376.54400
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	307.72000	307.70600
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.77796	0.74650
		Q3B	Q3B default	unknown ❌	600.05900	1799.65000
		STP	stp_st default	unknown ❌	600.03300	600.00100
			stp_mt default	unsat ✅	162.74700	512.35100
		Yices2	Yices2-Main default	unsat ✅	0.37608	0.37378
		Z3	z3-4.5.0 default	unsat ✅	32.27430	32.26420
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.78907	0.78901
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	20.87710	20.87640
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	474.47000	474.43000
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.48351	0.94674
			Minkeyrink ST_st	unsat ✅	0.45153	0.45174
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	83.10460	83.10500
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	87.09510	345.09400
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	41.81860	41.81710
		Yices2	Yices 2.6.0_default	unsat ✅	0.28505	0.28497
		Z3	z3-4.7.1_default	unsat ✅	7.91873	7.91753
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.78125	0.78124
			Poolector-wrapped-sq_default	unsat ✅	0.60175	1.81000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	3.96124	3.96101
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	9.98259	9.98219
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.40599	0.76239
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.37275	0.37281
		Par4	Par4-wrapped-sq_default	unsat ✅	0.32771	0.00664
		STP	STP-2019-wrapped-sq_default	unsat ✅	225.83900	225.78800
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	2223.61000	2223.55000
			stp-minisat-wrapped-sq_default	unsat ✅	415.45100	415.44900
			stp-mt-wrapped-sq_default	unsat ✅	12.00400	46.35310
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	2341.28000	3085.25000
			stp-riss-wrapped-sq_default	unknown ❌	0.43570	0.43590
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.33631	0.33634
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	1.88367	1.88375
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.32773	0.32773
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2399.88000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.28446	0.28445
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	72.49120	72.49180
SMT-COMP 2020	0.22 (7/9)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.47725	0.47715
		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.47614	0.47609
			Poolector-wrapped-sq_default	unsat ✅	0.48029	0.47234
		CVC4	CVC4-sq-final_default	unsat ✅	28.12610	28.12450
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.95000
		MathSAT	MathSAT5_default.sh	unknown ❌	1200.02000	1199.67000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.29234	0.29256
			MinkeyRink Solver 2020.3_default	unsat ✅	0.40732	0.74799
		STP	STP_default	unsat ✅	0.44413	1.02320
			STP ++ Mergsat v1_default	unsat ✅	0.41070	0.41234
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.59940	0.59937
		Z3	z3-4.8.8_default	unsat ✅	141.25200	141.21500
SMT-COMP 2021	0.25 (3/4)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.74190	0.74184
		MathSAT	mathsat-5.6.6_default	unknown ❌	1200.02000	1199.85000
		STP	STP 2021.0_default	unsat ✅	0.37687	0.75224
		Z3	z3-4.8.11_default	unsat ✅	16.60290	16.60160
SMT-COMP 2025		Bitwuzla	Bitwuzla	unsat ✅	1.10869	0.97435
			Bitwuzla-MachBV-base	unsat ✅	0.54184	0.42618
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	0.70026	0.58191
		BVDecide	bv_decide	unsat ✅	9.87115	9.68895
			bv_decide-nokernel	unsat ✅	5.53379	5.40859
		cvc5	cvc5	unsat ✅	64.86994	64.73911
		SMTInterpol	SMTInterpol	unsat ✅	7.02563	16.45534
		Yices2	Yices2	unsat ✅	0.91729	0.78960
		Z3alpha	Z3-alpha	unsat ✅	11.48898	41.65949
		Z3	Z3-alpha-base	unsat ✅	231.02107	230.85762
			Z3-Owl-base	unsat ✅	337.79631	337.63169
			z3siri-base	unsat ✅	233.65817	233.51834
		Z3-Owl	Z3-Owl	unsat ✅	492.50150	492.28343