Benchmark

non-incremental/QF_UF/QG-classification/qg5/iso_brn1216.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/

Benchmark
Size	24815
Compressed Size	4073
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	crafted
First Occurrence	2007-07-03
Generated By	—
Generated On	—
Generator	—
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	sat
Inferred Status	sat
Size	24807
Compressed Size	4087
Max. Term Depth	27
Asserts	15
Declared Functions	2
Declared Constants	5
Declared Sorts	2
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

not	346	or	469	and	420	=	654
let	8

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT Evaluation 2013		CVC3	CVC3-SMT-COMP-2010 default	sat ✅	0.04956	—
			CVC3-SMT-COMP-2011 default	sat ✅	0.04626	—
			CVC3-SMT-COMP-2012 default	sat ✅	0.05392	—
		CVC4	CVC4-SMT-COMP-2011 default	sat ✅	0.02901	—
			CVC4-SMT-COMP-2012-Resubmission default	sat ✅	0.03905	—
			CVC4-SMT-EVAL-2013 default	sat ✅	0.03695	—
		MathSAT	MathSAT5-5.2.6-SMT-EVAL-2013 default	sat ✅	0.02621	—
			MathSAT5-SMT-COMP-2010 default	sat ✅	—	—
			MathSAT5-SMT-COMP-2011 default	sat ✅	0.03278	—
			MathSAT5-SMT-COMP-2012 default	sat ✅	0.02414	—
			test_pmathsat-SMT-COMP-2010 default	sat ✅	0.03409	—
		OpenSMT	OpenSMT-SMT-COMP-2010 default	sat ✅	0.02435	—
			OpenSMT-SMT-COMP-2011 default	sat ✅	0.01749	—
			OpenSMT-SMT-EVAL-2013 default	unknown ❌	—	—
		SMTInterpol	SMTInterpol-2.0r8402-SMT-EVAL-2013 default	sat ✅	0.49616	—
			SMTInterpol-SMT-COMP-2011 default	sat ✅	0.40714	—
			SMTInterpol-SMT-COMP-2012 default	sat ✅	0.39134	—
		veriT	veriT-SMT-COMP-2010 default	unknown ❌	—	—
			veriT-SMT-COMP-2011 default	sat ✅	0.03372	—
			veriT-SMT-EVAL-2013 default	sat ✅	0.02045	—
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default	sat ✅	0.01525	—
			Z3-SMT-COMP-2011 default	sat ✅	0.02615	—
SMT-COMP 2014		CVC4	CVC4 f7118b2 default	sat ✅	0.04729	0.03699
		MathSAT	MathSAT-5.2.12-Main default	sat ✅	0.03757	0.02399
		OpenSMT	opensmt2-2014-06-14c default	sat ✅	0.03349	0.02499
		SMTInterpol	smtinterpol-2.1-118-g3dada2f default	sat ✅	0.60595	0.90786
		veriT	veriT-smtcomp2014 default	sat ✅	0.02766	0.01900
		Yices2	Yices-2.2.1-smtcomp2014 default	sat ✅	0.01321	0.00500
		Z3	Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default	sat ✅	0.02577	0.01700
SMT-COMP 2015		CVC4	CVC4-master-2015-06-15-9b32405-main default	sat ✅	0.04525	0.04299
			CVC4-experimental-2015-06-15-ff5745a-main default	sat ✅	0.05676	0.04299
		MathSAT	MathSat 5.3.6 main smtcomp2015_main	sat ✅	0.03284	0.03199
		OpenSMT	OpenSMT2 default	sat ✅	0.03826	0.03699
			OpenSMT2-parallel default	sat ✅	0.03898	0.03799
		SMTInterpol	SMTInterpol v2.1-206-g86e9531 default	sat ✅	0.58219	0.92586
		SMT-RAT	SMT-RAT-final default	sat ✅	0.06555	0.06499
		veriT	veriT default	sat ✅	0.01674	0.01600
		Yices2	Yices default	sat ✅	0.00833	0.00600
		Z3	z3 4.4.0 default	sat ✅	0.03784	0.03799
SMT-COMP 2016		CVC4	CVC4-master-2016-05-27-cfef263-main default	sat ✅	0.04538	0.04556
		MathSAT	mathsat-5.3.11-linux-x86_64-Main default	sat ✅	0.02932	0.03029
		OpenSMT	OpenSMT2-2016-05-12 default	sat ✅	0.03343	0.03335
		SMTInterpol	smtinterpol-2.1-258-g92ab3df default	sat ✅	0.40208	0.83463
		Toysmt	toysmt default	sat ✅	2.48480	2.48642
		veriT	veriT-dev default	sat ✅	0.01326	0.01377
		Yices2	Yices-2.4.2 default	sat ✅	0.01231	0.00757
		Z3	z3-4.4.1 default	sat ✅	0.03915	0.04041
SMT-COMP 2017		CVC4	CVC4-smtcomp2017-main default	sat ✅	0.04648	0.04543
		MathSAT	mathsat-5.4.1-linux-x86_64-Main default	sat ✅	0.02770	0.02787
		OpenSMT	opensmt2-2017-06-04 default	sat ✅	0.04064	0.03621
		SMTInterpol	SMTInterpol default	sat ✅	0.44377	0.93732
		veriT	veriT-2017-06-17 default	sat ✅	0.01930	0.01342
		Yices2	Yices2-Main default	sat ✅	0.01028	0.00601
		Z3	z3-4.5.0 default	sat ✅	0.04200	0.04085
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	0.04915	0.04925
		MathSAT	mathsat-5.5.2-linux-x86_64-Main_default	sat ✅	0.02784	0.02859
		OpenSMT	opensmt2_default	sat ✅	0.03509	0.03502
		SMTInterpol	SMTInterpol-2.5-19-g0d39cdee_default	sat ✅	0.47630	1.07685
		veriT	veriT_default	sat ✅	0.01410	0.01420
		Yices2	Yices 2.6.0_default	sat ✅	0.00871	0.00868
		Z3	z3-4.7.1_default	sat ✅	0.04359	0.04355
SMT-COMP 2021		MathSAT	mathsat-5.6.6_default	sat ✅	0.03150	0.03147
		Par4	Par4-wrapped-sq_default	sat ✅	0.01719	0.00624
		SMTInterpol	smtinterpol-2.5-823-g881e8631_default	sat ✅	0.51509	1.21004
		veriT	veriT_default	sat ✅	0.01723	0.01748
		Yices2	Yices 2.6.2 bug fix_default	sat ✅	0.02665	0.00662
			Yices 2.6.2 for SMTCOMP2020_default	sat ✅	0.01373	0.00685
		Z3	z3-4.8.11_default	sat ✅	0.02752	0.02747
			z3-4.8.8_default	sat ✅	0.04298	0.04295
SMT-COMP 2022		cvc5	cvc5-default-2022-07-02-b15e116-wrapped_sq	sat ✅	0.05472	0.05514
		MathSAT	MathSAT-5.6.8_default	sat ✅	0.03283	0.03276
		veriT	veriT_default	sat ✅	0.01730	0.01758
		Yices2	Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.01012	0.00689
		Z3	z3-4.8.17_default	sat ✅	0.02880	0.03060
			z3-4.8.11_default	sat ✅	0.03050	0.03042
SMT-COMP 2023		cvc5	cvc5-default-2023-05-16-ea045f305_sq	sat ✅	0.04819	0.04863
		OpenSMT	OpenSMT a78dcf01_default	sat ✅	0.01999	0.01996
		SMTInterpol	smtinterpol-2.5-1272-g2d6d356c_default	sat ✅	0.63051	1.48586
		Yices2	Yices 2 for SMTCOMP 2023_default	sat ✅	0.01059	0.00717
			Yices 2.6.2 for SMTCOMP 2021_default	sat ✅	0.01103	0.00725