Benchmark

non-incremental/QF_BV/Sage2/bench_9149.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf

Benchmark
Size	166974
Compressed Size	16541
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2015-07-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	166966
Compressed Size	16639
Max. Term Depth	265
Asserts	510
Declared Functions	0
Declared Constants	386
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	1	ite	19	not	206	=	391
let	3136	bvor	67	bvadd	708	bvmul	700
bvule	5	bvuge	17	bvslt	51	bvsle	3
bvsgt	27	bvsge	34	bvshl	86	zero_extend	1288
sign_extend	43

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2017	0.38 (5/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	sat ✅	7.32461	7.32335
			Boolector SMT17 final boolector	sat ✅	408.81400	408.81400
		CVC4	CVC4-smtcomp2017-main default	sat ✅	26.37180	52.88420
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	11.66120	11.66090
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	15.72710	25.76000
		Q3B	Q3B default	unknown ❌	600.05700	1787.03000
		STP	stp_st default	unknown ❌	600.01900	599.81000
			stp_mt default	unknown ❌	600.06000	2382.40000
		Yices2	Yices2-Main default	sat ✅	0.13108	0.13062
		Z3	z3-4.5.0 default	unknown ❌	600.11500	600.00100
SMT-COMP 2018	0.14 (6/7)	Boolector	Boolector_default	sat ✅	7.25327	7.25165
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	11.45600	11.45620
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	2.29411	2.29481
		MinkeyRink	Minkeyrink MT_mt	sat ✅	59.47550	233.28300
			Minkeyrink ST_st	sat ✅	94.33650	94.33310
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	660.11000	660.03200
			STP-CMS-mt-2018_multicore-no-stderr	unknown ❌	1200.06000	4765.02000
			STP-Riss-st-2018_riss-no-stderr	sat ✅	5.64850	5.64836
		Yices2	Yices 2.6.0_default	sat ✅	0.12300	0.12295
		Z3	z3-4.7.1_default	unknown ❌	1200.11000	1199.91000
SMT-COMP 2019	0.12 (7/8)	Boolector	Boolector-wrapped-sq_default	sat ✅	0.82666	0.82668
			Poolector-wrapped-sq_default	sat ✅	1.08635	3.76000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	375.47200	375.45800
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	3.28379	3.28373
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	57.33570	225.14300
			MinkeyRink ST-wrapped-sq_default	sat ✅	78.78380	78.78290
		Par4	Par4-wrapped-sq_default	sat ✅	0.12531	0.00575
		STP	STP-2019-wrapped-sq_default	unknown ❌	2400.01000	2399.73000
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	530.52400	530.48900
			stp-minisat-wrapped-sq_default	unknown ❌	2400.03000	2399.79000
			stp-mt-wrapped-sq_default	sat ✅	1838.48000	7297.50000
			stp-portfolio-fixed-wrapped-sq_default	unknown ❌	2400.09000	5382.04000
			stp-riss-wrapped-sq_default	unknown ❌	1.75787	1.75794
		Yices2	Yices 2.6.2-wrapped-sq_default	sat ✅	0.12732	0.12731
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	4.93646	4.93593
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	87.54010	87.53120
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	sat ✅	0.68870	0.68869
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	0.51623	0.51628
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unknown ❌	2400.11000	2400.07000
SMT-COMP 2020	0.11 (8/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.81954	0.81500
		Boolector	Boolector-wrapped-sq_default	sat ✅	0.84494	0.84496
			Poolector-wrapped-sq_default	sat ✅	1.08620	4.76110
		CVC4	CVC4-sq-final_default	sat ✅	3.67925	3.67901
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.89000
		MathSAT	MathSAT5_default.sh	sat ✅	0.77208	0.77205
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.84374	0.84392
			MinkeyRink Solver 2020.3_default	sat ✅	63.98030	242.63300
		STP	STP_default	sat ✅	57.14920	224.08200
			STP ++ Mergsat v1_default	sat ✅	13.06880	13.06760
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	5.93617	5.93451
		Z3	z3-4.8.8_default	sat ✅	110.20100	110.08000
SMT-COMP 2021		Bitwuzla	Bitwuzla-fixed_default	sat ✅	0.82284	0.82275
		MathSAT	mathsat-5.6.6_default	sat ✅	0.67086	0.67074
		STP	STP 2021.0_default	sat ✅	95.56270	340.29200
		Z3	z3-4.8.11_default	sat ✅	198.77100	198.71900
SMT-COMP 2023	0.17 (5/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	3.12896	3.12881
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	4.46744	4.46808
		STP	STP 2022.4_default	sat ✅	0.92235	0.92227
			STP 2022.4_default	sat ✅	0.92237	0.92239
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	1200.05000	1246.58000
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.13858	0.13854
		Z3-Owl	z3-Owl-Final_default	sat ✅	98.88780	98.87630
			z3-Owl-Final_default	sat ✅	80.36220	80.35900