Benchmark

non-incremental/QF_IDL/asp/15Puzzle/15-puzzle.init13.smt2

Benchmark without description.

Benchmark
Size	2444804
Compressed Size	346634
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2011-06-30
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	2444796
Compressed Size	346638
Max. Term Depth	4
Asserts	1
Declared Functions	0
Declared Constants	29288
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

true	170	not	14586	or	4343	and	21739
=>	3066	=	30820	-	1921	>=	388

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013	0.40 (3/5)	CVC3	CVC3-SMT-COMP-2010 default	unknown ❌	—	—
			CVC3-SMT-COMP-2011 default	unknown ❌	—	—
			CVC3-SMT-COMP-2012 default	unknown ❌	—	—
		CVC4	CVC4-SMT-COMP-2012-Resubmission default	sat ✅	17.34170	—
			CVC4-SMT-EVAL-2013 default	sat ✅	34.75490	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	unknown ❌	—	—
			OpenSMT-SMT-COMP-2011 default	unknown ❌	—	—
		veriT	veriT-SMT-COMP-2010 default	unknown ❌	—	—
			veriT-SMT-COMP-2011 default	unknown ❌	—	—
			veriT-SMT-EVAL-2013 default	sat ✅	106.92600	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	28.70620	—
			Z3-SMT-COMP-2011 default	sat ✅	12.22290	—
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	21.89020	21.89870
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	22.06930	22.07560
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	sat ✅	54.28540	62.39350
		veriT	veriT default	sat ✅	69.34760	69.32950
		Yices2	Yices default	sat ✅	43.67150	43.68140
		Z3	z3 4.4.0 default	sat ✅	18.42310	18.41720
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	34.33690	34.35690
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	sat ✅	84.06430	103.55200
		veriT	veriT-dev default	sat ✅	75.54020	75.56440
		Yices2	Yices-2.4.2 default	sat ✅	30.63280	30.65020
		Z3	z3-4.4.1 default	sat ✅	22.36340	22.37760
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	sat ✅	30.09360	30.07700
		SMTInterpol	SMTInterpol default	sat ✅	210.27200	226.06800
		veriT	veriT-2017-06-17 default	sat ✅	49.15390	49.15530
		Yices2	Yices2-Main default	sat ✅	35.87100	35.87050
		Z3	z3-4.5.0 default	sat ✅	31.53670	31.53020
SMT-COMP 2018	0.14 (6/7)	CVC4	CVC4-experimental-idl-2_default	unknown ❌	1200.05000	1200.00000
			master-2018-06-10-b19c840-competition-default_default	sat ✅	13.99780	13.99770
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	45.30750	45.29940
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	sat ✅	272.60800	289.53200
		SMT-RAT	SMTRAT-Rat-final_default	unknown ❌	1200.01000	1199.91000
		veriT	veriT_default	sat ✅	63.21790	63.20860
		Yices2	Yices 2.6.0_default	sat ✅	31.45420	31.45500
		Z3	z3-4.7.1_default	sat ✅	27.86010	27.85750
SMT-COMP 2019	0.14 (6/7)	CVC4	CVC4-2019-06-03-d350fe1-wrapped-sq_default	sat ✅	28.03060	28.02990
		Par4	Par4-wrapped-sq_default	sat ✅	32.77460	129.85000
		ProB	ProB-wrapped-sq_default	unknown ❌	2400.04000	2399.79000
		SMTInterpol	smtinterpol-2.5-514-wrapped-sq_default	sat ✅	438.42700	459.45700
		veriT	veriT-wrapped-sq_default	sat ✅	85.53930	85.54180
		Yices2	Yices 2.6.0_default	sat ✅	40.77440	40.77650
			Yices 2.6.2-wrapped-sq_default	sat ✅	40.78660	40.78020
		Z3	z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	10.09660	10.09390
SMT-COMP 2020		CVC4	CVC4-sq-final_default	sat ✅	32.19160	32.18960
		MathSAT	MathSAT5_default.sh	sat ✅	54.01520	54.00970
		Par4	Par4-wrapped-sq_default	sat ✅	7.20526	28.34000
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	sat ✅	478.77600	506.29900
		veriT	veriT_default	sat ✅	37.17410	37.17270
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	21.38110	21.37830
		Z3	z3-4.8.8_default	sat ✅	16.07920	16.07530
			z3-4.8.4-d6df51951f4c-wrapped-sq_default	sat ✅	21.36070	21.36170
SMT-COMP 2023	0.33 (4/6)	cvc5	cvc5-default-2023-05-16-ea045f305_sq	unknown ❌	1200.12000	1199.77000
		OpenSMT	OpenSMT a78dcf01_default	unknown ❌	1200.02000	1199.93000
		Par4	Par4-wrapped-sq_default	sat ✅	14.31910	56.56000
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	sat ✅	235.73600	262.74400
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	72.96350	72.93470
		Z3++	Z3++_sq_0526_default	sat ✅	51.76020	51.75870
SMT-COMP 2024	0.40 (3/5)	cvc5	cvc5	unknown ❌	1202.74411	1201.82759
		OpenSMT	OpenSMT	unknown ❌	1201.62529	1201.38398
		SMTInterpol	SMTInterpol	sat ✅	297.04464	433.81683
		Yices2	Yices2	sat ✅	30.19295	30.09158
		Z3alpha	Z3-alpha	sat ✅	22.06834	21.96768