Benchmark

non-incremental/QF_UF/QG-classification/loops6/iso_icl054.smt2

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size60651
Compressed Size11437
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 60643
Compressed Size11467
Max. Term Depth38
Asserts 13
Declared Functions2
Declared Constants7
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not772 or1253 and896 =1298
let12

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 0.20793
CVC3-SMT-COMP-2011 default unsat ✅ 0.18832
CVC3-SMT-COMP-2012 default unsat ✅ 0.18836
CVC4 CVC4-SMT-COMP-2011 default unsat ✅ 0.07645
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.09374
CVC4-SMT-EVAL-2013 default unsat ✅ 0.09087
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.04898
MathSAT5-SMT-COMP-2010 default unsat ✅ 0.05388
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.06659
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.05041
test_pmathsat-SMT-COMP-2010 default unsat ✅ 0.06180
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 0.06261
OpenSMT-SMT-COMP-2011 default unsat ✅ 0.05664
OpenSMT-SMT-EVAL-2013 default unsat ✅ 0.40435
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 0.98191
SMTInterpol-SMT-COMP-2011 default unsat ✅ 1.12948
SMTInterpol-SMT-COMP-2012 default unsat ✅ 0.81506
veriT veriT-SMT-COMP-2010 default unsat ✅ 0.07763
veriT-SMT-COMP-2011 default unsat ✅ 0.07106
veriT-SMT-EVAL-2013 default unsat ✅ 0.04800
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.03801
Z3-SMT-COMP-2011 default unsat ✅ 0.03740
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 0.11957 0.10898
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.05608 0.04499
OpenSMT opensmt2-2014-06-14c default unsat ✅ 0.09544 0.07899
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 0.89214 1.73374
veriT veriT-smtcomp2014 default unsat ✅ 0.06095 0.05199
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.01624 0.00800
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.04138 0.03199
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.10414 0.10198
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.10539 0.10298
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.05563 0.05499
OpenSMT OpenSMT2 default unsat ✅ 0.08395 0.08299
OpenSMT2-parallel default unsat ✅ 0.08414 0.08299
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unsat ✅ 0.88238 1.64875
SMT-RAT SMT-RAT-final default unsat ✅ 0.15315 0.15198
veriT veriT default unsat ✅ 0.03735 0.03599
Yices2 Yices default unsat ✅ 0.00811 0.00700
Z3 z3 4.4.0 default unsat ✅ 0.05290 0.05299
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.08451 0.08465
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.03947 0.04039
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 0.09808 0.09808
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 0.56999 1.48081
Toysmt toysmt default unknown ❌ 3.08174 3.08039
veriT veriT-dev default unsat ✅ 0.02570 0.02588
Yices2 Yices-2.4.2 default unsat ✅ 0.01284 0.00866
Z3 z3-4.4.1 default unsat ✅ 0.05005 0.05125
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.09374 0.09320
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.06140 0.06074
OpenSMT opensmt2-2017-06-04 default unsat ✅ 0.07972 0.07901
SMTInterpol SMTInterpol default unsat ✅ 0.61762 1.57882
veriT veriT-2017-06-17 default unsat ✅ 0.02140 0.02156
Yices2 Yices2-Main default unsat ✅ 0.01115 0.00982
Z3 z3-4.5.0 default unsat ✅ 0.05580 0.05151
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.11467 0.11484
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.04197 0.04297
OpenSMT opensmt2_default unsat ✅ 0.09664 0.09603
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 0.59077 1.55363
veriT veriT_default unsat ✅ 0.02302 0.02316
Yices2 Yices 2.6.0_default unsat ✅ 0.01364 0.01350
Z3 z3-4.7.1_default unsat ✅ 0.05704 0.05698
SMT-COMP 2019 Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 60.90930 241.57000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.09711 0.09725
OpenSMT OpenSMT-wrapped-sq_default unsat ✅ 0.07565 0.07556
Par4 Par4-wrapped-sq_default unsat ✅ 0.02079 0.00619
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 0.58387 1.45356
veriT veriT-wrapped-sq_default unsat ✅ 0.02873 0.02905
Yices2 Yices 2.6.0_default unsat ✅ 0.01462 0.01458
Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01314 0.01317
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.06017 0.06018
SMT-COMP 2020 0.18 (9/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 49.79020 197.41000
CVC4 CVC4-sq-final_default unsat ✅ 0.14020 0.14046
MathSAT MathSAT5_default.sh unsat ✅ 0.05605 0.05601
OpenSMT OpenSMT_default unsat ✅ 0.05192 0.05187
Par4 Par4-wrapped-sq_default unsat ✅ 0.02054 0.00616
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 0.58286 1.48887
veriT veriT_default unsat ✅ 0.02727 0.02749
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01058 0.01053
Z3 z3-4.8.8_default unsat ✅ 0.06132 0.06129
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.26448 0.16529
OpenSMT OpenSMT unsat ✅ 0.24312 0.14346
plat-smt plat-smt unsat ✅ 0.23915 0.13954
SMTInterpol SMTInterpol unsat ✅ 1.04425 2.55725
Yices2 Yices2 unsat ✅ 0.22854 0.12883
Z3alpha Z3-alpha unsat ✅ 0.29156 0.19184
SMT-COMP 2025 cvc5 cvc5 unsat ✅ 0.33026 0.20295
OpenSMT OpenSMT unsat ✅ 0.30636 0.17874
SMTInterpol SMTInterpol unsat ✅ 0.89725 2.16158
Yices2 Yices2 unsat ✅ 0.28123 0.16081