Benchmark

non-incremental/QF_BV/Sage2/bench_822.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	2461035
Compressed Size	27722
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	2461027
Compressed Size	27710
Max. Term Depth	582
Asserts	641
Declared Functions	0
Declared Constants	154
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	35	not	150	=	258
let	53626	extract	34	bvand	2	bvor	54
bvadd	39693	bvmul	5006	bvult	115	bvule	114
bvugt	4	bvuge	168	bvsgt	16	bvshl	54
bvlshr	17	zero_extend	8546

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.12 (7/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unsat ✅	0.85722	0.85619
			Boolector SMT17 final boolector	unsat ✅	1.16299	1.16211
		CVC4	CVC4-smtcomp2017-main default	unsat ✅	76.45110	151.28800
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	38.34480	38.34340
		MinkeyRink	MinkeyRink 2017.3a default	unsat ✅	0.93021	0.92885
		Q3B	Q3B default	unknown ❌	600.05800	1799.52000
		STP	stp_st default	unsat ✅	0.68997	0.68950
			stp_mt default	unsat ✅	0.70724	1.28471
		Yices2	Yices2-Main default	unsat ✅	2.47984	2.47899
		Z3	z3-4.5.0 default	unsat ✅	12.97940	12.97750
SMT-COMP 2018		Boolector	Boolector_default	unsat ✅	0.79520	0.79504
		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	18.61960	18.62030
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	67.67840	67.67690
		MinkeyRink	Minkeyrink MT_mt	unsat ✅	0.46319	0.60974
			Minkeyrink ST_st	unsat ✅	0.45326	0.45341
		STP	STP-CMS-st-2018_default-no-stderr	unsat ✅	0.44580	0.44597
			STP-CMS-mt-2018_multicore-no-stderr	unsat ✅	0.45358	0.48899
			STP-Riss-st-2018_riss-no-stderr	unsat ✅	0.66411	0.66403
		Yices2	Yices 2.6.0_default	unsat ✅	1.66972	1.66939
		Z3	z3-4.7.1_default	unsat ✅	25.29830	25.29840
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	unsat ✅	0.88514	0.88513
			Poolector-wrapped-sq_default	unsat ✅	0.78432	2.69000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	unsat ✅	0.60355	0.60355
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unsat ✅	9.36528	9.36545
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	unsat ✅	0.44673	0.49779
			MinkeyRink ST-wrapped-sq_default	unsat ✅	0.41601	0.41605
		Par4	Par4-wrapped-sq_default	unsat ✅	0.81672	2.27000
		STP	STP-2019-wrapped-sq_default	unsat ✅	0.48118	0.48138
			stp-mergesat-fixed-wrapped-sq_default	unsat ✅	0.49312	0.49330
			stp-minisat-wrapped-sq_default	unsat ✅	0.48489	0.48512
			stp-mt-wrapped-sq_default	unsat ✅	0.48630	0.50187
			stp-portfolio-fixed-wrapped-sq_default	unsat ✅	0.52352	0.57018
			stp-riss-wrapped-sq_default	unknown ❌	0.47844	0.47867
		Yices2	Yices 2.6.2-wrapped-sq_default	unsat ✅	4.68310	4.68305
			Yices 2.6.2 Cadical-wrapped-sq_default	unsat ✅	1.58070	1.58059
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	unsat ✅	2.69877	2.69861
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.04000	2400.00000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	unsat ✅	1.05090	1.05080
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	10.88580	10.88520
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.91005	0.90994
		Boolector	Boolector-wrapped-sq_default	unsat ✅	1.12255	1.12257
			Poolector-wrapped-sq_default	unsat ✅	0.88100	2.84270
		CVC4	CVC4-sq-final_default	unsat ✅	10.06880	10.06890
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.05000	1199.95000
		MathSAT	MathSAT5_default.sh	unsat ✅	103.45700	103.45300
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.37784	0.37804
			MinkeyRink Solver 2020.3_default	unsat ✅	0.52183	0.91451
		STP	STP_default	unsat ✅	0.41516	0.44179
			STP ++ Mergsat v1_default	unsat ✅	0.47491	0.47485
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	1.38272	1.38257
		Z3	z3-4.8.8_default	unsat ✅	22.26070	22.25890
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	unsat ✅	0.91477	0.91467
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	unsat ✅	12.43720	12.43450
		STP	STP 2022.4_default	unsat ✅	0.37046	0.37049
			STP 2022.4_default	unsat ✅	0.37016	0.37023
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.03000	1248.49000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	11.91090	11.91000
		Z3-Owl	z3-Owl-Final_default	unsat ✅	13.41360	13.41330
			z3-Owl-Final_default	unsat ✅	7.85193	7.85085
SMT-COMP 2025		Bitwuzla	Bitwuzla	unsat ✅	0.76792	0.64863
			Bitwuzla-MachBV-base	unsat ✅	0.51629	0.39854
		Bitwuzla-MachBV	Bitwuzla-MachBV	unsat ✅	0.60669	0.48649
		BVDecide	bv_decide	unsat ✅	216.35460	216.16745
			bv_decide-nokernel	unsat ✅	48.02150	47.84404
		cvc5	cvc5	unsat ✅	8.28833	8.16892
		SMTInterpol	SMTInterpol	unsat ✅	1131.90999	1163.83458
		Yices2	Yices2	unsat ✅	1.56687	1.44602
		Z3alpha	Z3-alpha	unsat ✅	4.00557	13.85872
		Z3	Z3-alpha-base	unsat ✅	7.97928	7.86228
			Z3-Owl-base	unsat ✅	34.47360	34.35278
			z3siri-base	unsat ✅	8.14261	8.01180
		Z3-Owl	Z3-Owl	unsat ✅	5.62590	5.50622