Benchmark

non-incremental/QF_BV/Sage2/bench_4528.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	16989
Compressed Size	1515
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	16981
Compressed Size	1506
Max. Term Depth	21
Asserts	58
Declared Functions	0
Declared Constants	6
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	not	13	=	14	let	367
bvadd	201	bvmul	4	bvult	7	bvule	19
bvugt	2	bvuge	15	bvlshr	6	zero_extend	143

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017		Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.05975	0.05922
			Boolector SMT17 final boolector	unsat ✅	0.15457	0.15401
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.41502	0.80884
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.17952	0.07242
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.09514	0.05859
		Q3B	Q3B default	unsat ✅	0.12939	0.12928
		STP	stp_st default	unsat ✅	0.19364	0.19263
			stp_mt default	unsat ✅	0.35082	0.71138
		Yices2	Yices2-Main default	unsat ✅	0.00940	0.00534
		Z3	z3-4.5.0 default	unsat ✅	50.32600	50.32520
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.04009	0.04003
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.11282	0.11298
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.06488	0.06595
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.04523	0.05028
			Minkeyrink ST_st	unsat ✅	0.04184	0.04209
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.29010	0.28993
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.26520	0.93473
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.34776	0.34788
		Yices2	Yices 2.6.0_default	unsat ✅	0.00956	0.00779
		Z3	z3-4.7.1_default	unsat ✅	34.09300	68.13060
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.06481	0.06480
			Poolector-wrapped-sq_default	unsat ✅	0.17566	0.17298
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.10341	0.10344
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	0.06300	0.06326
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.05323	0.05625
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.04821	0.04828
		Par4	Par4-wrapped-sq_default	unsat ✅	0.01691	0.00651
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.24124	0.24153
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	4.17783	4.17764
			stp-minisat-wrapped-sq_default	unsat ✅	0.12781	0.12804
			stp-mt-wrapped-sq_default	unsat ✅	0.24697	0.83125
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	4.21157	4.51852
			stp-riss-wrapped-sq_default	unknown ❌	0.03990	0.04011
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	0.00948	0.00851
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	0.00987	0.00987
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	0.00956	0.00957
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2399.85000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	0.01119	0.01118
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	14.52430	14.52440
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.08457	0.08455
		MathSAT	mathsat-5.6.6_default	unsat ✅	0.03687	0.03681
		STP	STP 2021.0_default	unsat ✅	0.02777	0.03205
		Z3	z3-4.8.11_default	unsat ✅	6.17567	6.17577
SMT-COMP 2022		Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.09079	0.09077
			Bitwuzla-wrapped_default	unsat ✅	0.08755	0.08737
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unsat ✅	0.32889	0.33025
		MathSAT	MathSAT-5.6.8_default	unsat ✅	0.03529	0.03525
		STP	STP 2022.4_default	unsat ✅	0.02595	0.02600
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	0.01074	0.00752
		Z3++BV	z3++bv_0702_default	unsat ✅	4.07509	4.07486
		Z3	z3-4.8.17_default	unsat ✅	15.95800	15.95870
SMT-COMP 2024		Bitwuzla	Bitwuzla	unsat ✅	0.26871	0.16910
		cvc5	cvc5	unsat ✅	0.43594	0.33630
		SMTInterpol	SMTInterpol	unsat ✅	0.72444	1.45344
		STP	STP	unsat ✅	0.22453	0.12472
		Yices2	Yices2	unsat ✅	0.22733	0.12581
		Z3alpha	Z3-alpha	unsat ✅	5.51905	5.41460