Benchmark

non-incremental/QF_BV/Sage2/bench_15498.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	96543
Compressed Size	10552
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	96535
Compressed Size	10557
Max. Term Depth	60
Asserts	388
Declared Functions	0
Declared Constants	209
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	10	not	35	=	108
let	1664	extract	69	bvand	12	bvor	102
bvadd	566	bvmul	246	bvult	83	bvule	110
bvugt	27	bvuge	69	bvshl	112	bvlshr	66
zero_extend	436

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.14181	0.14176
			Boolector SMT17 final boolector	unsat ✅	0.48378	0.48310
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	7.55176	15.07560
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	1.39950	1.40101
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.22866	0.22030
		Q3B	Q3B default	unknown ❌	600.03100	1799.37000
		STP	stp_st default	unsat ✅	31.19090	31.18770
			stp_mt default	unsat ✅	27.11610	85.35750
		Yices2	Yices2-Main default	unsat ✅	0.02558	0.02477
		Z3	z3-4.5.0 default	unsat ✅	0.73876	0.73864
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.09646	0.09641
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	14.87990	14.87930
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	1.54501	1.54598
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.14182	0.18480
			Minkeyrink ST_st	unsat ✅	0.13350	0.13370
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	20.50400	20.50200
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	21.68730	85.67140
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	48.94660	48.94070
		Yices2	Yices 2.6.0_default	unsat ✅	0.02704	0.02699
		Z3	z3-4.7.1_default	unsat ✅	0.89715	0.89697
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.13575	0.13578
			Poolector-wrapped-sq_default	unsat ✅	0.18091	0.16393
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.27364	0.27367
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	37.83210	37.83450
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.13526	0.18072
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.12402	0.12409
		Par4	Par4-wrapped-sq_default	unsat ✅	0.03856	0.00645
		STP	STP-2019-wrapped-sq_default	unsat ✅	18.46620	18.46340
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	25.84960	25.84600
			stp-minisat-wrapped-sq_default	unsat ✅	28.25370	28.25500
			stp-mt-wrapped-sq_default	unsat ✅	17.86400	70.44990
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	28.96890	72.65830
			stp-riss-wrapped-sq_default	unknown ❌	0.15561	0.15580
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.03352	0.03355
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.03954	0.03956
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.04205	0.04208
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unsat ✅	0.06132	0.06130
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.06918	0.06917
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	0.53771	0.53770
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.15699	0.15690
		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.14929	0.14930
			Poolector-wrapped-sq_default	unsat ✅	0.17692	0.16954
		CVC4	CVC4-sq-final_default	unsat ✅	21.61010	21.61060
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.04000	1199.90000
		MathSAT	MathSAT5_default.sh	unsat ✅	0.74569	0.74560
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.11618	0.11641
			MinkeyRink Solver 2020.3_default	unsat ✅	0.12691	0.16018
		STP	STP_default	unsat ✅	0.10235	0.13316
			STP ++ Mergsat v1_default	unsat ✅	0.09426	0.09593
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.03650	0.03648
		Z3	z3-4.8.8_default	unsat ✅	21.70010	21.69770
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.13858	0.13853
			Bitwuzla-wrapped_default	unsat ✅	0.14622	0.14616
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	10.14290	10.14220
		MathSAT	MathSAT-5.6.8_default	unsat ✅	0.61553	0.61530
		STP	STP 2022.4_default	unsat ✅	0.10425	0.10430
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.03753	0.03748
		Z3++BV	z3++bv_0702_default	unsat ✅	11.39520	11.39320
		Z3	z3-4.8.17_default	unsat ✅	0.52795	0.52956
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	unsat ✅	0.31813	0.21837
		cvc5	cvc5	unsat ✅	5.54070	5.44030
		SMTInterpol	SMTInterpol	unknown ❌	1201.75250	1228.61971
		STP	STP	unsat ✅	0.28612	0.18610
		Yices2	Yices2	unsat ✅	0.23490	0.13450
		Z3alpha	Z3-alpha	unsat ✅	11.18362	11.07844