Benchmark

non-incremental/QF_BV/VS3/VS3-benchmark-A7.smt2

Tool generated benchmark from the project
VS3: Verification and Synthesis using SMT Solvers 
Project Webpage: http://www.cs.umd.edu/~saurabhs/pacs/
Contributed by Saurabh Srivastava (saurabhs@cs.umd.edu)
Solving time (June 2009): 45 minutes

Benchmark
Size	44847
Compressed Size	6058
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2009-08-02
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	44839
Compressed Size	6073
Max. Term Depth	14
Asserts	508
Declared Functions	0
Declared Constants	172
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

=

164

bvadd

686

bvmul

1090

bvsle

344

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2010	1.00 (0/3)	CVC3	CVC3 2.3	unknown ❌	256.50000	—
		SONOLAR	SONOLAR r252	unknown ❌	1200.00000	—
		STP	simplifyingSTP	unknown ❌	1200.00000	—
SMT-COMP 2012	0.57 (3/7)	4Simp	4Simp	sat ✅	111.40000	—
		Abziz	AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6	sat ✅	486.90000	—
		Boolector	Boolector	unknown ❌	1200.00000	—
		CVC3	CVC3 v2.4.2	unknown ❌	128.10000	—
			CVC4 1.0rc.3931	unknown ❌	1200.00000	—
		MathSAT	MathSAT-HeavyBV	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	unknown ❌	1200.00000	—
		Z3	Z3	sat ✅	286.80000	—
SMT-COMP 2011	0.50 (3/6)	Boolector	Boolector 1.5.23-833	sat ✅	191.20000	—
		CVC3	CVC3 v2.4	unknown ❌	131.50000	—
		MathSAT	MathSAT5	unknown ❌	1200.00000	—
		SONOLAR	SONOLAR	unknown ❌	1200.00000	—
		STP	simplifyingSTP	unknown ❌	1200.00000	—
			STP2	sat ✅	308.70000	—
		Z3	Z3	sat ✅	12.70000	—
SMT Evaluation 2013	0.22 (7/9)	4Simp	4Simp-SMT-COMP-2012 default	sat ✅	35.83620	—
		Abziz	abziz_portfolio_2011_minfeatures_2 default	unknown ❌	—	—
			abziz_portfolio_2011_solvers_2 default	unknown ❌	—	—
			abziz_portfolio_2012_minfeatures default	sat ✅	1113.08000	—
			abziz_portfolio_2012_solvers default	unknown ❌	—	—
			AbzizPortfolio-SMT-COMP-2012 default	unknown ❌	—	—
		Boolector	Boolector-1.5.118-SMT-EVAL-2013 default	sat ✅	1182.24000	—
			Boolector-SMT-COMP-2011 default	sat ✅	109.86100	—
			Boolector-SMT-COMP-2012 default	sat ✅	1105.83000	—
		CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	314.08100	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	sat ✅	616.64500	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unknown ❌	—	—
			MathSAT5-HeavyBV-SMT-COMP-2012 default	sat ✅	471.49400	—
			MathSAT5-SMT-COMP-2011 default	unknown ❌	—	—
			MathSAT5-SMT-COMP-2012 default	unknown ❌	—	—
		SONOLAR	SONOLAR-2013-05-15-SMT-EVAL-2013 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2010 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2011 default	unknown ❌	—	—
			SONOLAR-SMT-COMP-2012 default	unknown ❌	—	—
		STP	STP2-SMT-COMP-2011 default	sat ✅	320.55000	—
			STP2-SMT-COMP-2012 default	sat ✅	526.03000	—
			simplifyingSTP-SMT-COMP-2010 default	sat ✅	487.85800	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	78.04130	—
			Z3-SMT-COMP-2011 default	sat ✅	158.63200	—
SMT-COMP 2014	0.22 (7/9)	4Simp	4Simp - 2014 default	sat ✅	182.20500	182.26200
		Abziz	abziz_portfolio_all_features default	sat ✅	33.20590	33.09770
			abziz_portfolio_min_features default	sat ✅	33.34910	33.24870
		Boolector	Boolector boolector	sat ✅	133.62400	133.66200
		CVC4	CVC4 f7118b2 default	unknown ❌	1197.13000	2402.30000
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	1564.05000	1564.60000
		SONOLAR	sonolar_smtcomp-2014 default	sat ✅	254.64900	254.71900
		STP	stp-cryptominisat4 default	sat ✅	18.87420	18.86310
		Yices2	Yices-2.2.1-smtcomp2014 default	unknown ❌	2399.12000	2400.05000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	146.51000	146.54700
SMT-COMP 2015	0.29 (5/7)	Boolector	Boolector SMT15 QF_BV final boolector_qf_bv	sat ✅	182.85200	182.91500
		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	315.69100	633.76500
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	50.56810	101.38000
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	1873.24000	1873.92000
		SMT-RAT	SMT-RAT-final default	unknown ❌	2400.01000	2400.92000
		STP	stp-cryptominisat4 default	sat ✅	116.53300	116.55800
			stp-cmsat4-v15 default	sat ✅	125.86800	125.91700
			stp-cmsat4-mt-v15 default	unknown ❌	0.43709	0.43593
			stp-minisat-v15 default	sat ✅	1883.97000	1884.69000
		Yices2	Yices default	unknown ❌	2400.01000	2401.18000
		Z3	z3 4.4.0 default	sat ✅	186.15500	186.21000
SMT-COMP 2016	0.20 (8/10)	ABC	ABC_default default_abc	sat ✅	1485.35000	1486.18000
			ABC_glucose glucose	sat ✅	346.24300	346.44600
		Boolector	Boolector boolector	sat ✅	183.08300	183.18800
			Boolector preprop boolector	sat ✅	178.36300	178.45500
		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	158.67000	318.75100
		MapleSTP	MapleSTP default	sat ✅	1470.87000	1471.71000
			MapleSTP-mt default	sat ✅	287.29900	1140.41000
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	357.50400	357.67200
		MinkeyRink	Minkeyrink 2016 default	sat ✅	65.98550	253.14800
		Q3B	Q3B default	unknown ❌	122.39100	244.50600
		STP	stp-cms-exp-2016 default	sat ✅	82.24870	82.27910
			stp-cms-mt-2016 default	sat ✅	39.85440	156.96100
			stp-cms-st-2016 default	sat ✅	55.18490	55.20480
			stp-minisat-st-2016 default	unknown ❌	2400.10000	2401.32000
		Yices2	Yices-2.4.2 default	unknown ❌	2400.02000	2401.35000
		Z3	z3-4.4.1 default	sat ✅	80.84350	80.88760
SMT-COMP 2017	0.25 (6/8)	Boolector	Boolector+CaDiCaL SMT17 final boolector	unknown ❌	600.01500	599.98100
			Boolector SMT17 final boolector	sat ✅	161.95200	161.94900
		CVC4	CVC4-smtcomp2017-main default	sat ✅	73.46170	147.66100
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	431.00900	430.93900
		MinkeyRink	MinkeyRink 2017.3a default	sat ✅	86.21710	168.95000
		Q3B	Q3B default	unknown ❌	0.32085	0.53381
		STP	stp_st default	sat ✅	135.56800	135.55400
			stp_mt default	sat ✅	74.36090	294.41400
		Yices2	Yices2-Main default	unknown ❌	600.01600	600.02100
		Z3	z3-4.5.0 default	sat ✅	89.95790	89.95110
SMT-COMP 2018	0.14 (6/7)	Boolector	Boolector_default	sat ✅	396.66500	396.67300
		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	55.22770	55.22480
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	54.70420	54.69980
		MinkeyRink	Minkeyrink MT_mt	sat ✅	115.49200	457.93900
			Minkeyrink ST_st	sat ✅	255.95300	255.93500
		STP	STP-CMS-st-2018_default-no-stderr	sat ✅	174.09800	174.10000
			STP-CMS-mt-2018_multicore-no-stderr	sat ✅	76.02110	301.21600
			STP-Riss-st-2018_riss-no-stderr	sat ✅	686.54800	686.49000
		Yices2	Yices 2.6.0_default	unknown ❌	1200.01000	1200.03000
		Z3	z3-4.7.1_default	sat ✅	205.52500	205.50300
SMT-COMP 2019		Boolector	Boolector-wrapped-sq_default	sat ✅	83.89110	83.89200
			Poolector-wrapped-sq_default	sat ✅	100.32600	397.20000
		Boolector-ReasonLS	boolector-ReasonLS-wrapped-sq_default	sat ✅	868.44800	868.33200
		CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	64.02080	64.01300
		MinkeyRink	MinkeyRink MT-wrapped-sq_default	sat ✅	73.58650	291.30800
			MinkeyRink ST-wrapped-sq_default	sat ✅	87.96410	87.95620
		Par4	Par4-wrapped-sq_default	sat ✅	232.76900	698.02000
		STP	STP-2019-wrapped-sq_default	sat ✅	90.36640	90.36000
			stp-mergesat-fixed-wrapped-sq_default	sat ✅	85.73840	85.71390
			stp-minisat-wrapped-sq_default	sat ✅	1353.39000	1353.14000
			stp-mt-wrapped-sq_default	sat ✅	104.85400	415.21300
			stp-portfolio-fixed-wrapped-sq_default	sat ✅	1358.41000	1562.71000
			stp-riss-wrapped-sq_default	unknown ❌	0.43858	0.43878
		Yices2	Yices 2.6.2-wrapped-sq_default	unknown ❌	2400.06000	2399.92000
			Yices 2.6.2 Cadical-wrapped-sq_default	sat ✅	702.46500	702.38700
			Yices 2.6.2 Cryptominisat-wrapped-sq_default	sat ✅	70.53090	70.52460
			Yices 2.6.2 MCSAT BV-wrapped-sq_default	unknown ❌	2400.03000	2399.63000
			Yices 2.6.2 new bvsolver-wrapped-sq_default	sat ✅	27.08820	27.08330
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	135.80900	135.77500
SMT-COMP 2020	0.22 (7/9)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	185.27200	185.23100
		Boolector	Boolector-wrapped-sq_default	sat ✅	57.41880	57.41670
			Poolector-wrapped-sq_default	sat ✅	70.07030	277.09200
		CVC4	CVC4-sq-final_default	sat ✅	76.55450	76.54460
		LazyBV2Int	LazyBV2Int20200523_default.sh	unknown ❌	1200.02000	1199.86000
		MathSAT	MathSAT5_default.sh	unknown ❌	1200.11000	1199.83000
		MinkeyRink	MinkeyRink Solver 2020.3.1_default	unknown ❌	0.42085	0.42089
			MinkeyRink Solver 2020.3_default	sat ✅	42.71430	168.43800
		STP	STP_default	sat ✅	48.23250	190.63300
			STP ++ Mergsat v1_default	sat ✅	108.63400	108.60600
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	26.15850	26.15740
		Z3	z3-4.8.8_default	sat ✅	500.15600	500.08700
SMT-COMP 2021	0.25 (3/4)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	73.21150	73.18740
		MathSAT	mathsat-5.6.6_default	unknown ❌	1200.01000	1199.85000
		STP	STP 2021.0_default	sat ✅	46.45220	183.29600
		Z3	z3-4.8.11_default	sat ✅	550.25000	550.19500
SMT-COMP 2022	0.14 (6/7)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	61.54100	61.54490
			Bitwuzla-wrapped_default	sat ✅	61.10310	61.10250
		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	79.32710	79.27610
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.03000	1199.84000
		STP	STP 2022.4_default	sat ✅	68.72150	68.72440
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	52.04270	52.03420
		Z3++BV	z3++bv_0702_default	sat ✅	27.00180	26.99700
		Z3	z3-4.8.17_default	sat ✅	91.60420	91.60240
SMT-COMP 2023	0.33 (4/6)	Bitwuzla	Bitwuzla-fixed_default	sat ✅	355.38400	355.35100
		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	72.18060	72.16950
		STP	STP 2022.4_default	sat ✅	17.05270	17.05160
			STP 2022.4_default	sat ✅	17.05510	17.05460
		UltimateEliminator	UltimateIntBlastingWrapper+SMTInterpol_default	unknown ❌	4.42931	11.36810
		Yices2	Yices 2 for SMTCOMP 2023_default	unknown ❌	1200.03000	1199.89000
		Z3-Owl	z3-Owl-Final_default	unknown ❌	1200.02000	1199.85000
			z3-Owl-Final_default	sat ✅	302.13600	302.08100
SMT-COMP 2024	0.17 (5/6)	Bitwuzla	Bitwuzla	sat ✅	92.09013	91.95124
		cvc5	cvc5	sat ✅	66.56598	66.46299
		SMTInterpol	SMTInterpol	unknown ❌	2.66838	7.19074
		STP	STP	sat ✅	63.80591	63.70476
		Yices2	Yices2	sat ✅	22.81896	22.71783
		Z3alpha	Z3-alpha	sat ✅	371.24012	371.12798
SMT-COMP 2025	0.22 (7/9)	Bitwuzla	Bitwuzla	sat ✅	11.46130	11.33984
			Bitwuzla-MachBV-base	sat ✅	296.23451	296.04210
		Bitwuzla-MachBV	Bitwuzla-MachBV	sat ✅	299.59853	299.40788
		BVDecide	bv_decide	sat ✅	62.85283	62.73996
			bv_decide-nokernel	sat ✅	62.19505	62.07061
		cvc5	cvc5	sat ✅	79.88168	79.74180
		SMTInterpol	SMTInterpol	unknown ❌	1.58131	4.13237
		Yices2	Yices2	sat ✅	8.13933	8.00785
		Z3alpha	Z3-alpha	sat ✅	223.94728	894.24922
		Z3	Z3-alpha-base	sat ✅	79.76315	79.61242
			Z3-Owl-base	sat ✅	315.77393	315.61831
			z3siri-base	sat ✅	80.75996	80.61604
		Z3-Owl	Z3-Owl	unknown ❌	1201.75801	1200.95730