Benchmark

non-incremental/QF_UF/QG-classification/qg5/iso_icl233.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/

Benchmark
Size	35841
Compressed Size	6046
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	35833
Compressed Size	6095
Max. Term Depth	27
Asserts	21
Declared Functions	2
Declared Constants	5
Declared Sorts	2
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	343	or	668	and	640	=	924
let	14

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.06383	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.06026	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.05698	—
		CVC4	CVC4-SMT-COMP-2011 default	unsat ✅	0.03786	—
			CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.04936	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.04671	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.03232	—
			MathSAT5-SMT-COMP-2010 default	unsat ✅	0.03808	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.04045	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.03293	—
			test_pmathsat-SMT-COMP-2010 default	unsat ✅	0.04107	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	unsat ✅	0.03623	—
			OpenSMT-SMT-COMP-2011 default	unsat ✅	0.03381	—
			OpenSMT-SMT-EVAL-2013 default	unsat ✅	0.09871	—
		SMTInterpol	SMTInterpol-2.0r8402-SMT-EVAL-2013 default	unsat ✅	0.70882	—
			SMTInterpol-SMT-COMP-2011 default	unsat ✅	0.70603	—
			SMTInterpol-SMT-COMP-2012 default	unsat ✅	0.53220	—
		veriT	veriT-SMT-COMP-2010 default	unsat ✅	0.06207	—
			veriT-SMT-COMP-2011 default	unsat ✅	0.04315	—
			veriT-SMT-EVAL-2013 default	unsat ✅	0.02477	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.02110	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.03236	—
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.05506	0.05299
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.05480	0.05299
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.03975	0.03899
		OpenSMT	OpenSMT2 default	unsat ✅	0.04745	0.04599
			OpenSMT2-parallel default	unsat ✅	0.04766	0.04699
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	unsat ✅	0.72382	1.29580
		SMT-RAT	SMT-RAT-final default	unsat ✅	0.09355	0.09298
		veriT	veriT default	unsat ✅	0.02097	0.02000
		Yices2	Yices default	unsat ✅	0.00810	0.00700
		Z3	z3 4.4.0 default	unsat ✅	0.04201	0.04199
SMT-COMP 2016	0.12 (7/8)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.05452	0.05490
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.03266	0.03403
		OpenSMT	OpenSMT2-2016-05-12 default	unsat ✅	0.05049	0.05046
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	unsat ✅	0.92605	2.13056
		Toysmt	toysmt default	unknown ❌	0.68117	0.68153
		veriT	veriT-dev default	unsat ✅	0.01706	0.01823
		Yices2	Yices-2.4.2 default	unsat ✅	0.01130	0.00672
		Z3	z3-4.4.1 default	unsat ✅	0.04234	0.04357
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.05803	0.05761
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.03335	0.03355
		OpenSMT	opensmt2-2017-06-04 default	unsat ✅	0.05048	0.04820
		SMTInterpol	SMTInterpol default	unsat ✅	0.51783	1.17931
		veriT	veriT-2017-06-17 default	unsat ✅	0.01697	0.01637
		Yices2	Yices2-Main default	unsat ✅	0.00848	0.00759
		Z3	z3-4.5.0 default	unsat ✅	0.04576	0.04506
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.06173	0.06185
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.03118	0.03215
		OpenSMT	opensmt2_default	unsat ✅	0.05214	0.05207
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	unsat ✅	0.50138	1.18715
		veriT	veriT_default	unsat ✅	0.01688	0.01700
		Yices2	Yices 2.6.0_default	unsat ✅	0.01089	0.01039
		Z3	z3-4.7.1_default	unsat ✅	0.04820	0.04809
SMT-COMP 2020	0.18 (9/11)	Alt-Ergo	Alt-Ergo-SMTComp-2020_default	unsat ✅	7.89825	31.12000
		CVC4	CVC4-sq-final_default	unsat ✅	0.09306	0.09338
		MathSAT	MathSAT5_default.sh	unsat ✅	0.03719	0.03712
		OpenSMT	OpenSMT_default	unsat ✅	0.03026	0.03020
		Par4	Par4-wrapped-sq_default	unsat ✅	0.02890	0.00605
		SMTInterpol	smtinterpol-2.5-679-gacfde87a_default	unsat ✅	0.55125	1.27286
		veriT	veriT_default	unsat ✅	0.02209	0.02118
		Yices2	Yices 2.6.2 bug fix_default	unsat ✅	0.02177	0.00899
		Z3	z3-4.8.8_default	unsat ✅	0.04722	0.04716