Benchmark

non-incremental/QF_IDL/queens_bench/n_queen/queen50-1.smt2

Queens benchmarks generated by Hyondeuk Kim in SMT-LIB format.

Benchmark
Size	104368
Compressed Size	14613
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2006-08-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	104360
Compressed Size	14858
Max. Term Depth	5
Asserts	1
Declared Functions	0
Declared Constants	51
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	3675	and	1	=	3675	let	1
-	2500	<=	50	>=	50

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.40 (3/5)	CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	36.10070	—
			CVC4-SMT-EVAL-2013 default	sat ✅	37.75640	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	sat ✅	15.99130	—
			OpenSMT-SMT-COMP-2011 default	sat ✅	12.07190	—
		veriT	veriT-SMT-COMP-2010 default	unknown ❌	—	—
			veriT-SMT-COMP-2011 default	unknown ❌	—	—
			veriT-SMT-EVAL-2013 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.28628	—
			Z3-SMT-COMP-2011 default	sat ✅	0.18626	—
SMT-COMP 2014		CVC4	CVC4 f7118b2 default	sat ✅	51.80940	51.81010
		veriT	veriT-smtcomp2014 default	sat ✅	178.36900	178.43800
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.07477	0.06599
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.24762	0.23296
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	40.43820	40.45180
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	40.09930	40.10990
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	sat ✅	15.27410	23.81240
		veriT	veriT default	sat ✅	98.57590	98.60500
		Yices2	Yices default	sat ✅	0.90934	0.90886
		Z3	z3 4.4.0 default	sat ✅	0.37524	0.37494
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	28.41680	28.41820
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	sat ✅	10.55490	18.92220
		veriT	veriT-dev default	sat ✅	141.15300	141.24500
		Yices2	Yices-2.4.2 default	sat ✅	0.08790	0.08824
		Z3	z3-4.4.1 default	sat ✅	0.24033	0.24167
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	sat ✅	37.60480	37.57870
		SMTInterpol	SMTInterpol default	sat ✅	21.87440	33.89530
		veriT	veriT-2017-06-17 default	sat ✅	171.30100	171.28700
		Yices2	Yices2-Main default	sat ✅	0.10384	0.10297
		Z3	z3-4.5.0 default	sat ✅	0.24838	0.24698
SMT-COMP 2018	0.14 (6/7)	CVC4	CVC4-experimental-idl-2_default	sat ✅	1.46068	1.46026
			master-2018-06-10-b19c840-competition-default_default	sat ✅	20.18220	20.18080
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	83.59700	83.58650
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	sat ✅	8.13687	15.98890
		SMT-RAT	SMTRAT-Rat-final_default	unknown ❌	1200.03000	1200.03000
		veriT	veriT_default	sat ✅	122.10100	122.08500
		Yices2	Yices 2.6.0_default	sat ✅	0.47782	0.47768
		Z3	z3-4.7.1_default	sat ✅	0.84760	0.84750
SMT-COMP 2020		CVC4	CVC4-sq-final_default	sat ✅	27.69630	27.69520
		MathSAT	MathSAT5_default.sh	sat ✅	55.48640	55.48490
		Par4	Par4-wrapped-sq_default	sat ✅	0.19561	0.00618
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	sat ✅	278.37900	300.20200
		veriT	veriT_default	sat ✅	87.23520	87.22480
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.18308	0.18288
		Z3	z3-4.8.8_default	sat ✅	0.25355	0.25344
			z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	0.23906	0.23907
SMT-COMP 2021		cvc5	cvc5-fixed_default	sat ✅	19.09610	19.09800
		MathSAT	mathsat-5.6.6_default	sat ✅	250.56500	250.55300
		OpenSMT	OpenSMT-fixed_default	sat ✅	38.44400	38.44170
		Par4	Par4-wrapped-sq_default	sat ✅	0.11700	0.00643
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	sat ✅	28.03330	43.45600
		veriT	veriT_default	sat ✅	30.52850	30.52830
		YicesLS	YicesLS_0611_1448_default	sat ✅	0.12721	0.02411
		Z3	z3-4.8.11_default	sat ✅	0.23583	0.23580
SMT-COMP 2022		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	25.83440	25.82940
		MathSAT	MathSAT-5.6.8_default	sat ✅	172.33200	172.33100
		Par4	Par4-wrapped-sq_default	sat ✅	0.38649	0.00659
		veriT	veriT_default	sat ✅	37.25240	37.25010
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	1.64633	1.64624
		Z3	z3-4.8.17_default	sat ✅	0.26478	0.26648
SMT-COMP 2023		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	30.21900	30.21130
		OpenSMT	OpenSMT a78dcf01_default	sat ✅	57.98490	57.98450
		Par4	Par4-wrapped-sq_default	sat ✅	0.47754	0.00643
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	sat ✅	84.23270	98.31880
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.42005	0.41909
		Z3++	Z3++_sq_0526_default	sat ✅	0.34737	0.34741