Benchmark

non-incremental/QF_UF/QG-classification/qg5/gensys_icl969.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size46319
Compressed Size6473
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 46311
Compressed Size6482
Max. Term Depth17
Asserts 136
Declared Functions1
Declared Constants5
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not605 or653 and906 =1320
let10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.11773
CVC3-SMT-COMP-2011 default unsat ✅ 2.88666
CVC3-SMT-COMP-2012 default unsat ✅ 2.81533
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 0.80747
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.01646
CVC4-SMT-EVAL-2013 default unsat ✅ 1.04589
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.27140
MathSAT5-SMT-COMP-2010 default unsat ✅ 1.31507
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.65028
MathSAT5-SMT-COMP-2012 default unknown ❌
test_pmathsat-SMT-COMP-2010 default unsat ✅ 1.49318
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 1.91566
OpenSMT-SMT-COMP-2011 default unsat ✅ 1.66719
OpenSMT-SMT-EVAL-2013 default unsat ✅ 13.98550
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 5.68058
SMTInterpol-SMT-COMP-2011 default unsat ✅ 11.87000
SMTInterpol-SMT-COMP-2012 default unsat ✅ 6.20717
veriT veriT-SMT-COMP-2010 default unsat ✅ 11.20120
veriT-SMT-COMP-2011 default unsat ✅ 2.56001
veriT-SMT-EVAL-2013 default unsat ✅ 0.99602
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.71106
Z3-SMT-COMP-2011 default unsat ✅ 0.68570
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 2.15857 2.14867
MathSAT MathSAT-5.2.12-Main default unsat ✅ 1.15478 1.12983
OpenSMT opensmt2-2014-06-14c default unsat ✅ 10.56790 10.56240
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 5.60211 8.42672
veriT veriT-smtcomp2014 default unsat ✅ 0.96585 0.95685
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.15200 0.14298
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 2.34942 2.34864
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.26665 2.26566
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.30071 2.29965
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 1.16161 1.16082
OpenSMT OpenSMT2 default unsat ✅ 11.32500 11.32830
OpenSMT2-parallel default unsat ✅ 8.18361 26.29700
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 5.05996 8.18075
SMT-RAT SMT-RAT-final default unsat ✅ 3.49807 3.49847
veriT veriT default unsat ✅ 0.27584 0.27496
Yices2 Yices default unsat ✅ 0.16890 0.16797
Z3 z3 4.4.0 default unsat ✅ 2.60598 2.60660
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.47779 2.47923
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 1.26562 1.26706
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 6.96274 6.96710
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 4.40229 8.48049
Toysmt toysmt default unsat ✅ 1857.49000 1858.43000
veriT veriT-dev default unsat ✅ 0.28997 0.28931
Yices2 Yices-2.4.2 default unsat ✅ 0.18106 0.18106
Z3 z3-4.4.1 default unsat ✅ 2.54122 2.54445
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.44374 2.44293
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 1.31004 1.31027
OpenSMT opensmt2-2017-06-04 default unsat ✅ 5.02532 5.01769
SMTInterpol SMTInterpol default unsat ✅ 7.24334 14.79900
veriT veriT-2017-06-17 default unsat ✅ 0.29996 0.29977
Yices2 Yices2-Main default unsat ✅ 0.15989 0.15930
Z3 z3-4.5.0 default unsat ✅ 2.67742 2.67686
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.69419 2.69428
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 1.32681 1.32751
OpenSMT opensmt2_default unsat ✅ 4.68791 4.68746
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 7.17936 13.03170
veriT veriT_default unsat ✅ 0.23338 0.23356
Yices2 Yices 2.6.0_default unsat ✅ 0.14576 0.14570
Z3 z3-4.7.1_default unsat ✅ 2.70300 2.70269
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9531.62000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.60761 2.60800
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 4.56425 4.56354
Par4 Par4-wrapped-sq_default unsat ✅ 0.16710 0.00576
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 6.21484 13.13740
veriT veriT-wrapped-sq_default unsat ✅ 0.29640 0.29643
Yices2 Yices 2.6.0_default unsat ✅ 0.16024 0.16020
Yices 2.6.2-wrapped-sq_default unsat ✅ 0.15769 0.15768
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 3.19099 3.19054
SMT-COMP 2020 0.27 (8/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.07000 4764.57000
CVC4 CVC4-sq-final_default unsat ✅ 2.89923 2.89843
MathSAT MathSAT5_default.sh unsat ✅ 1.35508 1.35483
OpenSMT OpenSMT_default unsat ✅ 4.68554 4.68515
Par4 Par4-wrapped-sq_default unsat ✅ 0.15108 0.00692
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 6.03062 11.16330
veriT veriT_default unsat ✅ 0.25078 0.25099
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.14945 0.14937
Z3 z3-4.8.8_default unsat ✅ 2.56816 2.56762
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 1.30824 1.30807
Par4 Par4-wrapped-sq_default unsat ✅ 0.15177 0.00628
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 11.42100 25.12520
veriT veriT_default unsat ✅ 0.25362 0.25388
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.14571 0.14563
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 0.14577 0.14572
Z3 z3-4.8.11_default unsat ✅ 2.81936 2.81948
z3-4.8.8_default unsat ✅ 2.86867 2.86836
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.55485 2.55342
MathSAT MathSAT-5.6.8_default unsat ✅ 1.35040 1.34638
veriT veriT_default unsat ✅ 0.23659 0.23684
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.15465 0.15456
Z3 z3-4.8.17_default unsat ✅ 2.35184 2.35225
z3-4.8.11_default unsat ✅ 2.36170 2.36076
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 2.19101 2.09043
OpenSMT OpenSMT unsat ✅ 2.81933 2.71880
plat-smt plat-smt unsat ✅ 1.56755 1.46733
SMTInterpol SMTInterpol unsat ✅ 15.73140 35.34014
Yices2 Yices2 unsat ✅ 0.34410 0.24348
Z3alpha Z3-alpha unsat ✅ 2.27413 2.17426
SMT-COMP 2025 cvc5 cvc5 unsat ✅ 1.71760 1.59595
OpenSMT OpenSMT unsat ✅ 1.89930 1.77537
SMTInterpol SMTInterpol unsat ✅ 14.27614 27.18460
Yices2 Yices2 unsat ✅ 0.41180 0.29194