Benchmark

non-incremental/QF_IDL/queens_bench/toroidal_bench/toroidal_queen15-1.smt2

Queens benchmarks generated by Hyondeuk Kim in SMT-LIB format.

Benchmark
Size	13650
Compressed Size	2015
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2006-08-21
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	13642
Compressed Size	2009
Max. Term Depth	5
Asserts	1
Declared Functions	0
Declared Constants	16
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	525	and	1	=	525	let	1
-	330	<=	15	>=	15

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.80 (1/5)	CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	unknown ❌	—	—
			CVC4-SMT-EVAL-2013 default	unknown ❌	—	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	unknown ❌	—	—
			OpenSMT-SMT-COMP-2011 default	unknown ❌	—	—
		veriT	veriT-SMT-COMP-2010 default	unknown ❌	—	—
			veriT-SMT-COMP-2011 default	unknown ❌	—	—
			veriT-SMT-EVAL-2013 default	unknown ❌	—	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	3.65975	—
			Z3-SMT-COMP-2011 default	unsat ✅	4.13523	—
SMT-COMP 2014	0.50 (2/4)	CVC4	CVC4 f7118b2 default	unknown ❌	2399.21000	2400.08000
		veriT	veriT-smtcomp2014 default	unknown ❌	2399.12000	2400.11000
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	1092.37000	1092.79000
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	5.26009	5.24520
SMT-COMP 2015	0.40 (3/5)	CVC4	CVC4-master-2015-06-15-9b32405-main default	unknown ❌	2400.01000	2400.90000
			CVC4-experimental-2015-06-15-ff5745a-main default	unknown ❌	2400.01000	2400.92000
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	unsat ✅	1386.74000	1473.60000
		veriT	veriT default	unknown ❌	2400.02000	2401.17000
		Yices2	Yices default	unsat ✅	1328.39000	1328.93000
		Z3	z3 4.4.0 default	unsat ✅	5.17555	5.17721
SMT-COMP 2016	0.40 (3/5)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unknown ❌	2400.08000	2401.54000
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	unsat ✅	1131.36000	1182.80000
		veriT	veriT-dev default	unknown ❌	2400.09000	2401.48000
		Yices2	Yices-2.4.2 default	unsat ✅	904.75600	905.27200
		Z3	z3-4.4.1 default	unsat ✅	5.41435	5.41820
SMT-COMP 2017	0.80 (1/5)	CVC4	CVC4-smtcomp2017-main default	unknown ❌	600.02000	599.92200
		SMTInterpol	SMTInterpol default	unknown ❌	600.05300	636.07000
		veriT	veriT-2017-06-17 default	unknown ❌	600.10500	600.04500
		Yices2	Yices2-Main default	unknown ❌	600.02000	599.97700
		Z3	z3-4.5.0 default	unsat ✅	6.04094	6.03973
SMT-COMP 2018	0.57 (3/7)	CVC4	CVC4-experimental-idl-2_default	unsat ✅	870.26800	870.28000
			master-2018-06-10-b19c840-competition-default_default	unknown ❌	1200.05000	1200.02000
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unknown ❌	1200.02000	1199.95000
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	unknown ❌	1200.02000	1248.04000
		SMT-RAT	SMTRAT-Rat-final_default	unknown ❌	1200.01000	1200.02000
		veriT	veriT_default	unknown ❌	1200.01000	1199.99000
		Yices2	Yices 2.6.0_default	unsat ✅	1022.81000	1022.82000
		Z3	z3-4.7.1_default	unsat ✅	4.98690	4.98665
SMT-COMP 2019	0.57 (3/7)	CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	unknown ❌	2400.02000	2399.69000
		Par4	Par4-wrapped-sq_default	unsat ✅	4.65537	18.33000
		ProB	ProB-wrapped-sq_default	unknown ❌	353.07500	353.07900
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	unknown ❌	2400.10000	2427.66000
		veriT	veriT-wrapped-sq_default	unknown ❌	2400.04000	2400.11000
		Yices2	Yices 2.6.0_default	unsat ✅	1034.12000	1034.00000
			Yices 2.6.2-wrapped-sq_default	unsat ✅	1111.16000	1111.08000
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	unsat ✅	5.02476	5.02444
SMT-COMP 2022	0.50 (3/6)	cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	unknown ❌	1200.06000	1199.72000
		MathSAT	MathSAT-5.6.8_default	unknown ❌	1200.12000	1200.05000
		Par4	Par4-wrapped-sq_default	unsat ✅	4.81879	18.77000
		veriT	veriT_default	unknown ❌	1200.01000	1199.89000
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	unsat ✅	1153.50000	1153.45000
		Z3	z3-4.8.17_default	unsat ✅	4.66990	4.67146
SMT-COMP 2023	0.50 (3/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unknown ❌	1200.02000	1199.89000
		OpenSMT	OpenSMT a78dcf01_default	unknown ❌	1200.01000	1199.92000
		Par4	Par4-wrapped-sq_default	unsat ✅	5.08816	18.94000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	unknown ❌	1200.04000	1378.81000
		Yices2	Yices 2 for SMTCOMP 2023_default	unsat ✅	795.52400	795.40400
		Z3++	Z3++_sq_0526_default	unsat ✅	4.47461	4.47444
SMT-COMP 2024	0.80 (1/5)	cvc5	cvc5	unknown ❌	1201.71237	1200.69380
		OpenSMT	OpenSMT	unknown ❌	1201.22069	1201.05290
		SMTInterpol	SMTInterpol	unknown ❌	1202.75474	1471.14903
		Yices2	Yices2	unknown ❌	1201.22272	1200.77603
		Z3alpha	Z3-alpha	unsat ✅	4.32857	4.22615
SMT-COMP 2025	0.67 (2/6)	cvc5	cvc5	unknown ❌	1201.79030	1201.02812
		OpenSMT	OpenSMT	unknown ❌	1201.28653	1200.98524
		SMTInterpol	SMTInterpol	unknown ❌	0.82640	1.85400
		Yices2	Yices2	unknown ❌	1201.27350	1200.96352
		Z3alpha	Z3-alpha	unsat ✅	5.22033	19.56133
		Z3	Z3-alpha-base	unsat ✅	4.01861	3.89862