Benchmark

non-incremental/QF_UF/QG-classification/qg6/iso_icl_nogen006.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size660291
Compressed Size39854
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 660283
Compressed Size39839
Max. Term Depth23
Asserts 731
Declared Functions2
Declared Constants6
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1131 or601 and25689 =26799
let7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2010 0.25 (3/4) CVC3 CVC3 2.3 unknown ❌ 1200.00000
OpenSMT OpenSMT-1.0-alpha unsat ✅ 74.30000
veriT veriT 201007 unsat ✅ 538.10000
Yices2 Yices 2 proto unsat ✅ 59.00000
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 284.06500
CVC3-SMT-COMP-2011 default unsat ✅ 256.89900
CVC3-SMT-COMP-2012 default unsat ✅ 244.29700
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 10.53340
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 13.97940
CVC4-SMT-EVAL-2013 default unsat ✅ 9.96491
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 32.38740
MathSAT5-SMT-COMP-2010 default unsat ✅ 31.68370
MathSAT5-SMT-COMP-2011 default unsat ✅ 24.61680
MathSAT5-SMT-COMP-2012 default unsat ✅ 24.08950
test_pmathsat-SMT-COMP-2010 default unsat ✅ 33.15800
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 26.90840
OpenSMT-SMT-COMP-2011 default unsat ✅ 26.61350
OpenSMT-SMT-EVAL-2013 default unsat ✅ 607.67600
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 139.04100
SMTInterpol-SMT-COMP-2011 default unsat ✅ 1231.09000
SMTInterpol-SMT-COMP-2012 default unsat ✅ 83.21800
veriT veriT-SMT-COMP-2010 default unsat ✅ 439.62700
veriT-SMT-COMP-2011 default unsat ✅ 5.77520
veriT-SMT-EVAL-2013 default unsat ✅ 0.99248
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 8.32834
Z3-SMT-COMP-2011 default unsat ✅ 8.05224
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 39.13080 39.13010
MathSAT MathSAT-5.2.12-Main default unsat ✅ 21.32290 21.32480
OpenSMT opensmt2-2014-06-14c default unsat ✅ 63.91180 63.92030
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 127.86200 132.82600
veriT veriT-smtcomp2014 default unsat ✅ 1.18994 1.18182
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 2.18857 2.18067
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 35.52010 35.52360
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 35.17030 35.18270
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 35.00890 35.02170
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 20.57190 20.57890
OpenSMT OpenSMT2 default unsat ✅ 218.53200 218.62000
OpenSMT2-parallel default unsat ✅ 28.01910 104.43700
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 111.35300 116.67500
SMT-RAT SMT-RAT-final default unsat ✅ 25.09700 25.10620
veriT veriT default unsat ✅ 0.92035 0.91986
Yices2 Yices default unsat ✅ 1.75569 1.75573
Z3 z3 4.4.0 default unsat ✅ 42.05140 42.06860
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 52.22810 52.24520
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 27.07820 27.09510
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 39.13280 39.15890
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 100.03200 113.77400
Toysmt toysmt default unknown ❌ 2400.03000 2401.37000
veriT veriT-dev default unsat ✅ 0.73623 0.73689
Yices2 Yices-2.4.2 default unsat ✅ 2.58666 2.58845
Z3 z3-4.4.1 default unsat ✅ 33.30870 33.32920
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 49.86740 49.85880
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 23.54660 23.54310
OpenSMT opensmt2-2017-06-04 default unsat ✅ 17.27970 17.27940
SMTInterpol SMTInterpol default unsat ✅ 145.32500 156.20400
veriT veriT-2017-06-17 default unsat ✅ 0.73198 0.73206
Yices2 Yices2-Main default unsat ✅ 2.03843 2.03817
Z3 z3-4.5.0 default unsat ✅ 42.44400 42.43910
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 46.90550 46.90530
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 25.59490 25.59470
OpenSMT opensmt2_default unsat ✅ 32.26210 32.25930
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 324.33600 336.80700
veriT veriT_default unsat ✅ 0.75246 0.75253
Yices2 Yices 2.6.0_default unsat ✅ 2.76509 2.76484
Z3 z3-4.7.1_default unsat ✅ 42.02680 42.01560
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.06000 9519.57000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 47.36870 47.36740
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 25.61740 25.61760
Par4 Par4-wrapped-sq_default unsat ✅ 2.41909 4.77000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 188.89600 203.40500
veriT veriT-wrapped-sq_default unsat ✅ 0.78609 0.78623
Yices2 Yices 2.6.0_default unsat ✅ 2.38684 2.38658
Yices 2.6.2-wrapped-sq_default unsat ✅ 2.26193 2.26182
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 35.01840 35.01480
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 35.43940 35.43240
MathSAT MathSAT-5.6.8_default unsat ✅ 17.41100 17.40370
veriT veriT_default unsat ✅ 0.70668 0.70698
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 1.35546 1.35515
Z3 z3-4.8.17_default unsat ✅ 39.65920 39.65760
z3-4.8.11_default unsat ✅ 41.12860 41.12320
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 47.94580 47.92120
OpenSMT OpenSMT a78dcf01_default unsat ✅ 31.87260 31.86960
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.08000 2320.05000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 2.02476 2.02445
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 1.99537 1.99532
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 41.56672 41.44644
OpenSMT OpenSMT unsat ✅ 35.05540 34.93996
plat-smt plat-smt unsat ✅ 107.30308 107.17187
SMTInterpol SMTInterpol unsat ✅ 1055.81636 2620.15673
Yices2 Yices2 unsat ✅ 1.62085 1.52028
Z3alpha Z3-alpha unsat ✅ 28.32502 28.22375
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 31.12889 31.00845
OpenSMT OpenSMT unsat ✅ 19.17475 19.04397
SMTInterpol SMTInterpol unknown ❌ 1201.85421 3387.34757
Yices2 Yices2 unsat ✅ 2.16875 2.04300