Benchmark

non-incremental/QF_UF/QG-classification/qg6/gensys_icl009.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size131719
Compressed Size11175
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 131711
Compressed Size11156
Max. Term Depth23
Asserts 732
Declared Functions1
Declared Constants6
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1215 or841 and3530 =4665
let9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Barcelogic Barcelogic 1.3 unsat ✅ 130.50000
CVC3 CVC3-1.5 unsat ✅ 1219.70000
MathSAT MathSAT-4.2 unsat ✅ 305.30000
OpenSMT OpenSMT 0.1 unsat ✅ 825.80000
Yices2 Yices2 (proto c) unsat ✅ 49.50000
Z3 Z3 0.1 unsat ✅ 311.10000
Z3.2 unsat ✅ 56.00000
SMT-COMP 2010 0.25 (3/4) CVC3 CVC3 2.3 unknown ❌ 1200.00000
OpenSMT OpenSMT-1.0-alpha unsat ✅ 93.50000
veriT veriT 201007 unsat ✅ 1076.20000
Yices2 Yices 2 proto unsat ✅ 30.30000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 233.67300
CVC3-SMT-COMP-2011 default unsat ✅ 209.67000
CVC3-SMT-COMP-2012 default unsat ✅ 200.04300
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 8.08763
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 5.84722
CVC4-SMT-EVAL-2013 default unsat ✅ 8.84679
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 19.42440
MathSAT5-SMT-COMP-2010 default unsat ✅ 31.11510
MathSAT5-SMT-COMP-2011 default unsat ✅ 20.56220
MathSAT5-SMT-COMP-2012 default unsat ✅ 23.62310
test_pmathsat-SMT-COMP-2010 default unsat ✅ 26.45500
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 21.83380
OpenSMT-SMT-COMP-2011 default unsat ✅ 25.04610
OpenSMT-SMT-EVAL-2013 default unsat ✅ 291.73400
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 127.43100
SMTInterpol-SMT-COMP-2011 default unsat ✅ 869.26800
SMTInterpol-SMT-COMP-2012 default unsat ✅ 146.77000
veriT veriT-SMT-COMP-2010 default unsat ✅ 553.14100
veriT-SMT-COMP-2011 default unsat ✅ 8.20839
veriT-SMT-EVAL-2013 default unsat ✅ 1.61974
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 10.01710
Z3-SMT-COMP-2011 default unsat ✅ 9.20041
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 36.09990 36.09750
MathSAT MathSAT-5.2.12-Main default unsat ✅ 23.95860 23.95840
OpenSMT opensmt2-2014-06-14c default unsat ✅ 55.42620 55.44060
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 142.50100 146.46500
veriT veriT-smtcomp2014 default unsat ✅ 2.20714 2.18767
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 1.36806 1.36779
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 40.41120 40.42090
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 43.97180 43.98830
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 43.86950 43.88530
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 19.46110 19.46800
OpenSMT OpenSMT2 default unsat ✅ 57.58350 57.60420
OpenSMT2-parallel default unsat ✅ 35.75020 136.20100
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 99.04530 103.41300
SMT-RAT SMT-RAT-final default unsat ✅ 33.30900 33.31790
veriT veriT default unsat ✅ 3.76638 3.76743
Yices2 Yices default unsat ✅ 1.37581 1.37579
Z3 z3 4.4.0 default unsat ✅ 33.54720 33.56190
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 40.61120 40.63470
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 20.39750 20.41230
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 30.58950 30.60010
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 149.21500 157.99200
Toysmt toysmt default unknown ❌ 2400.02000 2401.57000
veriT veriT-dev default unsat ✅ 1.63194 1.63360
Yices2 Yices-2.4.2 default unsat ✅ 2.03540 2.03652
Z3 z3-4.4.1 default unsat ✅ 30.12960 30.15090
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 34.55640 34.55300
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 24.59420 24.59130
OpenSMT opensmt2-2017-06-04 default unsat ✅ 33.99120 33.98590
SMTInterpol SMTInterpol default unsat ✅ 152.25100 158.17400
veriT veriT-2017-06-17 default unsat ✅ 1.95708 1.95548
Yices2 Yices2-Main default unsat ✅ 1.25607 1.25437
Z3 z3-4.5.0 default unsat ✅ 42.08900 42.08630
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 38.45280 38.44970
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 25.20530 25.20540
OpenSMT opensmt2_default unsat ✅ 24.30500 24.30390
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 251.76700 259.63900
veriT veriT_default unsat ✅ 1.89336 1.89330
Yices2 Yices 2.6.0_default unsat ✅ 1.73586 1.73584
Z3 z3-4.7.1_default unsat ✅ 39.48180 39.48170
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9522.50000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 37.35010 37.34950
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 29.60000 29.59590
Par4 Par4-wrapped-sq_default unsat ✅ 1.82362 3.58000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 140.65200 153.72800
veriT veriT-wrapped-sq_default unsat ✅ 1.78314 1.78330
Yices2 Yices 2.6.0_default unsat ✅ 1.81841 1.81807
Yices 2.6.2-wrapped-sq_default unsat ✅ 1.75484 1.75474
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 41.83710 41.83300
SMT-COMP 2020 0.27 (8/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.10000 4753.09000
CVC4 CVC4-sq-final_default unsat ✅ 35.01540 35.00190
MathSAT MathSAT5_default.sh unsat ✅ 31.23500 31.23600
OpenSMT OpenSMT_default unsat ✅ 36.73780 36.73270
Par4 Par4-wrapped-sq_default unsat ✅ 2.13033 4.20000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 180.76400 187.98700
veriT veriT_default unsat ✅ 1.49068 1.49087
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 2.12205 2.12180
Z3 z3-4.8.8_default unsat ✅ 44.03460 44.02830
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 44.35170 44.33310
MathSAT MathSAT-5.6.8_default unsat ✅ 33.51810 66.98750
veriT veriT_default unsat ✅ 1.48835 1.48294
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 1.63517 1.63508
Z3 z3-4.8.17_default unsat ✅ 40.33650 40.33170
z3-4.8.11_default unsat ✅ 44.28050 44.27400
SMT-COMP 2024 0.17 (5/6) cvc5 cvc5 unsat ✅ 35.59661 35.45890
OpenSMT OpenSMT unsat ✅ 29.15238 29.02570
plat-smt plat-smt unsat ✅ 39.96470 39.86220
SMTInterpol SMTInterpol unknown ❌ 1202.72449 3224.15576
Yices2 Yices2 unsat ✅ 1.50468 1.40467
Z3alpha Z3-alpha unsat ✅ 30.62660 30.51429
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 30.45104 30.32659
OpenSMT OpenSMT unsat ✅ 25.27687 25.15707
SMTInterpol SMTInterpol unknown ❌ 1133.65655 3373.10141
Yices2 Yices2 unsat ✅ 1.75122 1.62406