Benchmark

non-incremental/QF_SLIA/20180523-Reynolds/pyex/peterc-pyex-doc-cav17-zz/pymongo/pymongo-mongoclient/c4f87d9d59feb31d91599c468d5e0c41b55ca796275871a6f4cc6a71.smt2

Publications: "Scaling Up DPLL(T) String Solvers Using Context-Dependent Simplification" by A. Reynolds, M. Woo, C. Barrett, D. Brumley, T. Liang, and C. Tinelli, CAV 2017.

Benchmark
Size	20697
Compressed Size	894
License	Creative Commons Attribution 4.0 International (CC-BY-4.0)
Category	industrial
First Occurrence	2018-07-14
Generated By	Andrew Reynolds
Generated On	2018-04-25 00:00:00
Generator	PyEx, converted to v2.6 by CVC4
Dolmen OK	1
strict Dolmen OK	1
check-sat calls	1

Query 1

Status	unknown
Inferred Status	sat
Size	20688
Compressed Size	887
Max. Term Depth	320
Asserts	1
Declared Functions	0
Declared Constants	1
Declared Sorts	0
Defined Functions	0
Defined Recursive Functions	0
Defined Sorts	0
Constants	0
Declared Datatypes	0

Symbols

ite	34	not	65	and	305	=	39
+	106	-	362	>=	272	str.len	330
str.++	17	str.substr	225	str.contains	27	str.replace	17
str.indexof	107	str.at	1	str.prefixof	2

Evaluations

Evaluation	Rating	Solver	Variant	Result	Wallclock	CPU Time
SMT-COMP 2018		CVC4	master-2018-06-10-b19c840-competition-default_default	sat ✅	2.32948	2.32941
SMT-COMP 2024		cvc5	cvc5	sat ✅	0.42319	0.32344
		OSTRICH	OSTRICH	sat ✅	22.87316	75.76045
		Z3alpha	Z3-alpha	sat ✅	69.56947	69.44719
		Z3-Noodler	Z3-Noodler	sat ✅	0.47737	0.37789
SMT-COMP 2025	0.33 (4/6)	cvc5	cvc5	sat ✅	0.55862	0.44135
		OSTRICH	OSTRICH	sat ✅	90.95738	131.50143
		Z3alpha	Z3-alpha	unknown ❌	1202.29519	4800.12617
		Z3	Z3-alpha-base	unknown ❌	1201.35694	1200.91041
			Z3-Noodler-base	unknown ❌	1201.36150	1200.98855
		Z3-Noodler	Z3-Noodler	sat ✅	0.48834	0.35562
			Z3-Noodler-Mocha-base	sat ✅	0.48638	0.35806
		Z3-Noodler-Mocha	Z3-Noodler-Mocha	sat ✅	0.47109	0.34988