Benchmark

non-incremental/QF_UF/QG-classification/qg5/iso_icl498.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/

Benchmark
Size	24553
Compressed Size	4184
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unsat
Inferred Status	unsat
Size	24545
Compressed Size	4208
Max. Term Depth	27
Asserts	15
Declared Functions	2
Declared Constants	5
Declared Sorts	2
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	166	or	496	and	413	=	674
let	9

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		CVC3	CVC3-SMT-COMP-2010 default	unsat ✅	0.04390	—
			CVC3-SMT-COMP-2011 default	unsat ✅	0.04185	—
			CVC3-SMT-COMP-2012 default	unsat ✅	0.04009	—
		CVC4	CVC4-SMT-COMP-2011 default	unsat ✅	0.02681	—
			CVC4-SMT-COMP-2012-Resubmission default	unsat ✅	0.03784	—
			CVC4-SMT-EVAL-2013 default	unsat ✅	0.03438	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	unsat ✅	0.02809	—
			MathSAT5-SMT-COMP-2010 default	unsat ✅	0.02256	—
			MathSAT5-SMT-COMP-2011 default	unsat ✅	0.03396	—
			MathSAT5-SMT-COMP-2012 default	unsat ✅	0.02538	—
			test_pmathsat-SMT-COMP-2010 default	unsat ✅	0.03892	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	unsat ✅	0.02664	—
			OpenSMT-SMT-COMP-2011 default	unsat ✅	0.02045	—
			OpenSMT-SMT-EVAL-2013 default	unsat ✅	0.06197	—
		SMTInterpol	SMTInterpol-2.0r8402-SMT-EVAL-2013 default	unsat ✅	0.49871	—
			SMTInterpol-SMT-COMP-2011 default	unsat ✅	0.37184	—
			SMTInterpol-SMT-COMP-2012 default	unsat ✅	0.37980	—
		veriT	veriT-SMT-COMP-2010 default	unsat ✅	0.02970	—
			veriT-SMT-COMP-2011 default	unsat ✅	0.02922	—
			veriT-SMT-EVAL-2013 default	unsat ✅	0.01843	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	unsat ✅	0.01368	—
			Z3-SMT-COMP-2011 default	unsat ✅	0.02559	—
SMT-COMP 2014		CVC4	CVC4 f7118b2 default	unsat ✅	0.04635	0.03699
		MathSAT	MathSAT-5.2.12-Main default	unsat ✅	0.03573	0.02400
		OpenSMT	opensmt2-2014-06-14c default	unsat ✅	0.03318	0.02400
		SMTInterpol	smtinterpol-2.1-118-g3dada2f default	unsat ✅	0.50032	0.73389
		veriT	veriT-smtcomp2014 default	unsat ✅	0.02679	0.01800
		Yices2	Yices-2.2.1-smtcomp2014 default	unsat ✅	0.01297	0.00400
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	unsat ✅	0.02720	0.01500
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	unsat ✅	0.04017	0.03799
			CVC4-experimental-2015-06-15-ff5745a-main default	unsat ✅	0.04073	0.03799
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	unsat ✅	0.03343	0.03299
		OpenSMT	OpenSMT2 default	unsat ✅	0.03162	0.03099
			OpenSMT2-parallel default	unsat ✅	0.03140	0.03000
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	unsat ✅	0.56652	0.89086
		SMT-RAT	SMT-RAT-final default	unsat ✅	0.06458	0.06399
		veriT	veriT default	unsat ✅	0.01581	0.01500
		Yices2	Yices default	unsat ✅	0.00847	0.00500
		Z3	z3 4.4.0 default	unsat ✅	0.03748	0.03699
SMT-COMP 2016	0.12 (7/8)	CVC4	CVC4-master-2016-05-27-cfef263-main default	unsat ✅	0.04140	0.04155
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	unsat ✅	0.02767	0.02860
		OpenSMT	OpenSMT2-2016-05-12 default	unsat ✅	0.03427	0.03424
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	unsat ✅	0.39990	0.84513
		Toysmt	toysmt default	unknown ❌	1.23575	1.23638
		veriT	veriT-dev default	unsat ✅	0.01431	0.01446
		Yices2	Yices-2.4.2 default	unsat ✅	0.01425	0.00644
		Z3	z3-4.4.1 default	unsat ✅	0.07228	0.07471
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	unsat ✅	0.04371	0.04265
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	unsat ✅	0.02601	0.02625
		OpenSMT	opensmt2-2017-06-04 default	unsat ✅	0.03934	0.03869
		SMTInterpol	SMTInterpol default	unsat ✅	0.47798	0.91899
		veriT	veriT-2017-06-17 default	unsat ✅	0.01445	0.01394
		Yices2	Yices2-Main default	unsat ✅	0.00773	0.00605
		Z3	z3-4.5.0 default	unsat ✅	0.03918	0.03914
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	unsat ✅	0.04368	0.04381
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	unsat ✅	0.02878	0.02990
		OpenSMT	opensmt2_default	unsat ✅	0.02872	0.02866
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	unsat ✅	0.44353	0.98337
		veriT	veriT_default	unsat ✅	0.01512	0.01454
		Yices2	Yices 2.6.0_default	unsat ✅	0.01254	0.00828
		Z3	z3-4.7.1_default	unsat ✅	0.04277	0.04269