Benchmark

non-incremental/QF_UF/QG-classification/qg6/iso_icl_repgen_sk008.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size37642
Compressed Size5137
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 37634
Compressed Size5080
Max. Term Depth43
Asserts 18
Declared Functions5
Declared Constants11
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not405 or655 and754 =1211
let31

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 0.33 (4/6) Barcelogic Barcelogic 1.3 unsat ✅ 41.70000
CVC3 CVC3-1.5 unknown ❌ 1801.00000
MathSAT MathSAT-4.2 unsat ✅ 297.40000
OpenSMT OpenSMT 0.1 unknown ❌ 1800.80000
Yices2 Yices2 (proto c) unsat ✅ 10.30000
Z3 Z3 0.1 unsat ✅ 172.10000
Z3.2 unsat ✅ 10.80000
SMT-COMP 2009 0.40 (3/5) CVC3 CVC3 2.0 unknown ❌ 900.00000
MathSAT MathSAT 4.3 unsat ✅ 11.80000
OpenSMT OpenSMT 0.2 unsat ✅ 24.50000
veriT veriT 200907 unknown ❌ 900.00000
Yices2 Yices 2 proto unsat ✅ 13.80000
Yices2 (proto c) unsat ✅ 14.30000
SMT-COMP 2010 0.25 (3/4) CVC3 CVC3 2.3 unknown ❌ 1200.00000
OpenSMT OpenSMT-1.0-alpha unsat ✅ 15.00000
veriT veriT 201007 unsat ✅ 1054.50000
Yices2 Yices 2 proto unsat ✅ 19.10000
SMT-COMP 2011 0.12 (7/8) CVC3 CVC3 v2.4 unknown ❌ 1200.20000
CVC4 CVC4 1.0rc.2026 unsat ✅ 49.60000
MathSAT MathSAT 5 unsat ✅ 11.50000
MathSAT5 unsat ✅ 18.40000
OpenSMT opensmt unsat ✅ 17.50000
SMTInterpol SMTInterpol 2.0pre unsat ✅ 90.50000
veriT veriT unsat ✅ 8.90000
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 48.10000
Z3 Z3 unsat ✅ 13.10000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 551.09700
CVC3-SMT-COMP-2011 default unsat ✅ 508.71100
CVC3-SMT-COMP-2012 default unsat ✅ 474.62600
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 6.43057
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 8.03650
CVC4-SMT-EVAL-2013 default unsat ✅ 14.99800
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 6.44958
MathSAT5-SMT-COMP-2010 default unsat ✅ 6.21148
MathSAT5-SMT-COMP-2011 default unsat ✅ 7.83999
MathSAT5-SMT-COMP-2012 default unsat ✅ 8.47164
test_pmathsat-SMT-COMP-2010 default unsat ✅ 7.97276
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 11.91800
OpenSMT-SMT-COMP-2011 default unsat ✅ 12.86600
OpenSMT-SMT-EVAL-2013 default unsat ✅ 225.63600
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 19.03240
SMTInterpol-SMT-COMP-2011 default unsat ✅ 26.18620
SMTInterpol-SMT-COMP-2012 default unsat ✅ 18.72310
veriT veriT-SMT-COMP-2010 default unknown ❌
veriT-SMT-COMP-2011 default unsat ✅ 4.39773
veriT-SMT-EVAL-2013 default unsat ✅ 0.87137
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.40698
Z3-SMT-COMP-2011 default unsat ✅ 0.45732
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 57.64130 57.64820
MathSAT MathSAT-5.2.12-Main default unsat ✅ 6.46379 6.45802
OpenSMT opensmt2-2014-06-14c default unsat ✅ 91.86580 91.89600
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 28.35840 32.16910
veriT veriT-smtcomp2014 default unsat ✅ 0.66380 0.65490
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.29327 0.28396
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 9.49794 9.49256
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 82.69660 82.72540
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 82.98870 83.02040
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 6.80749 6.80896
OpenSMT OpenSMT2 default unsat ✅ 24.90290 24.91420
OpenSMT2-parallel default unsat ✅ 15.91360 57.11330
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 18.20220 20.58390
SMT-RAT SMT-RAT-final default unsat ✅ 81.33220 81.30060
veriT veriT default unsat ✅ 0.73871 0.73789
Yices2 Yices default unsat ✅ 0.38878 0.38794
Z3 z3 4.4.0 default unsat ✅ 6.92186 6.92495
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 55.52420 55.55260
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 11.20900 11.21700
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 18.09690 18.10740
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 23.72680 29.26440
Toysmt toysmt default unknown ❌ 2400.05000 2401.41000
veriT veriT-dev default unsat ✅ 0.31927 0.31999
Yices2 Yices-2.4.2 default unsat ✅ 0.42023 0.42027
Z3 z3-4.4.1 default unsat ✅ 6.67134 6.67688
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 71.68050 71.66810
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 7.58135 7.58147
OpenSMT opensmt2-2017-06-04 default unsat ✅ 18.11590 18.11400
SMTInterpol SMTInterpol default unsat ✅ 23.69440 31.45780
veriT veriT-2017-06-17 default unsat ✅ 0.63529 0.63444
Yices2 Yices2-Main default unsat ✅ 0.94865 0.94778
Z3 z3-4.5.0 default unsat ✅ 8.79239 8.79024
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 62.98650 62.98160
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 7.01304 7.01301
OpenSMT opensmt2_default unsat ✅ 15.15390 15.15310
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 29.31280 34.98510
veriT veriT_default unsat ✅ 0.68185 0.68172
Yices2 Yices 2.6.0_default unsat ✅ 0.10361 0.10351
Z3 z3-4.7.1_default unsat ✅ 8.17150 8.17084
SMT-COMP 2020 0.27 (8/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.08000 4759.72000
CVC4 CVC4-sq-final_default unsat ✅ 16.04520 16.04300
MathSAT MathSAT5_default.sh unsat ✅ 8.96919 8.96888
OpenSMT OpenSMT_default unsat ✅ 26.03480 26.03390
Par4 Par4-wrapped-sq_default unsat ✅ 1.35659 2.54000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 27.54160 34.34070
veriT veriT_default unsat ✅ 0.54859 0.54888
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.32868 1.32864
Z3 z3-4.8.8_default unsat ✅ 8.21238 8.21202
SMT-COMP 2021 MathSAT mathsat-5.6.6_default unsat ✅ 6.92205 6.92074
Par4 Par4-wrapped-sq_default unsat ✅ 0.27425 0.00637
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 44.44180 60.16230
veriT veriT_default unsat ✅ 0.28386 0.28412
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31329 0.31039
Yices 2.6.2 for SMTCOMP2020_default unsat ✅ 0.25865 0.25855
Z3 z3-4.8.11_default unsat ✅ 8.30396 8.30118
z3-4.8.8_default unsat ✅ 8.17925 8.17050
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 15.63670 15.63360
OpenSMT OpenSMT a78dcf01_default unsat ✅ 28.15100 28.15010
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 71.40780 112.20500
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.35773 0.35767
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.35742 0.35699