Benchmark

non-incremental/QF_UF/QG-classification/qg5/iso_brn1193.smt2 

http://www.cs.bham.ac.uk/~vxs/quasigroups/benchmark/
Benchmark
Size25930
Compressed Size4134
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2007-07-03
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 25922
Compressed Size4142
Max. Term Depth27
Asserts 16
Declared Functions2
Declared Constants5
Declared Sorts 2
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not396 or457 and456 =679
let8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default sat ✅ 0.04164 —
CVC3-SMT-COMP-2011 default sat ✅ 0.03932 —
CVC3-SMT-COMP-2012 default sat ✅ 0.03729 —
CVC4 CVC4-SMT-COMP-2011 default sat ✅ 0.03439 —
CVC4-SMT-COMP-2012-Resubmission default sat ✅ 0.04048 —
CVC4-SMT-EVAL-2013 default sat ✅ 0.03766 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 0.02878 —
MathSAT5-SMT-COMP-2010 default sat ✅ 0.02725 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.03350 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.02481 —
test_pmathsat-SMT-COMP-2010 default sat ✅ 0.03820 —
OpenSMT OpenSMT-SMT-COMP-2010 default sat ✅ 0.02380 —
OpenSMT-SMT-COMP-2011 default sat ✅ 0.01891 —
OpenSMT-SMT-EVAL-2013 default sat ✅ 0.06503 —
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default sat ✅ 0.53697 —
SMTInterpol-SMT-COMP-2011 default sat ✅ 0.37768 —
SMTInterpol-SMT-COMP-2012 default sat ✅ 0.40880 —
veriT veriT-SMT-COMP-2010 default sat ✅ 0.03256 —
veriT-SMT-COMP-2011 default sat ✅ 0.02912 —
veriT-SMT-EVAL-2013 default sat ✅ 0.02443 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.01545 —
Z3-SMT-COMP-2011 default sat ✅ 0.03583 —
SMT-COMP 2014 CVC4 CVC4 f7118b2 default sat ✅ 0.04857 0.03799
MathSAT MathSAT-5.2.12-Main default sat ✅ 0.03374 0.02499
OpenSMT opensmt2-2014-06-14c default sat ✅ 0.03270 0.02400
SMTInterpol smtinterpol-2.1-118-g3dada2f default sat ✅ 0.55775 0.81188
veriT veriT-smtcomp2014 default sat ✅ 0.02913 0.02000
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.01286 0.00400
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.02962 0.01900
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 0.04280 0.04099
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 0.04285 0.04099
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.03328 0.03199
OpenSMT OpenSMT2 default sat ✅ 0.03304 0.03199
OpenSMT2-parallel default sat ✅ 0.03311 0.03199
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 0.58205 0.91686
SMT-RAT SMT-RAT-final default sat ✅ 0.06368 0.06299
veriT veriT default sat ✅ 0.01637 0.01500
Yices2 Yices default sat ✅ 0.00842 0.00500
Z3 z3 4.4.0 default sat ✅ 0.03962 0.03999
SMT-COMP 2016 0.12 (7/8) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 0.04973 0.04988
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 0.02733 0.02824
OpenSMT OpenSMT2-2016-05-12 default sat ✅ 0.03730 0.03724
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 0.46972 1.05467
Toysmt toysmt default unknown ❌ 0.98146 0.98204
veriT veriT-dev default sat ✅ 0.01321 0.01350
Yices2 Yices-2.4.2 default sat ✅ 0.01302 0.00590
Z3 z3-4.4.1 default sat ✅ 0.03791 0.03918
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 0.04743 0.04788
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.02933 0.02806
OpenSMT opensmt2-2017-06-04 default sat ✅ 0.04175 0.04024
SMTInterpol SMTInterpol default sat ✅ 0.44341 0.96728
veriT veriT-2017-06-17 default sat ✅ 0.01374 0.01364
Yices2 Yices2-Main default sat ✅ 0.00743 0.00652
Z3 z3-4.5.0 default sat ✅ 0.04455 0.04316
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.04803 0.04815
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 0.02818 0.02921
OpenSMT opensmt2_default sat ✅ 0.04239 0.04234
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 0.48699 1.13285
veriT veriT_default sat ✅ 0.01545 0.01557
Yices2 Yices 2.6.0_default sat ✅ 0.01046 0.00935
Z3 z3-4.7.1_default sat ✅ 0.04604 0.04595
SMT-COMP 2019 0.12 (7/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 18.38040 37.18240
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.05599 0.05627
OpenSMT OpenSMT-wrapped-sq_default sat ✅ 0.03631 0.03372
Par4 Par4-wrapped-sq_default sat ✅ 0.01634 0.00613
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 0.48583 1.07091
veriT veriT-wrapped-sq_default sat ✅ 0.01803 0.01827
Yices2 Yices 2.6.0_default sat ✅ 0.01041 0.00893
Yices 2.6.2-wrapped-sq_default sat ✅ 0.02231 0.00893
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.04776 0.04777
SMT-COMP 2020 0.27 (8/11) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 20.67100 63.17940
CVC4 CVC4-sq-final_default sat ✅ 0.07462 0.07494
MathSAT MathSAT5_default.sh sat ✅ 0.03348 0.03338
OpenSMT OpenSMT_default sat ✅ 0.02308 0.02305
Par4 Par4-wrapped-sq_default sat ✅ 0.02488 0.00697
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 0.47891 1.01606
veriT veriT_default sat ✅ 0.01831 0.01853
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.01213 0.00662
Z3 z3-4.8.8_default sat ✅ 0.04375 0.04367
SMT-COMP 2021 MathSAT mathsat-5.6.6_default sat ✅ 0.03582 0.03580
Par4 Par4-wrapped-sq_default sat ✅ 0.01641 0.00638
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 0.53508 1.23821
veriT veriT_default sat ✅ 0.01898 0.01926
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.01160 0.00645
Yices 2.6.2 for SMTCOMP2020_default sat ✅ 0.01175 0.00643
Z3 z3-4.8.11_default sat ✅ 0.02875 0.02872
z3-4.8.8_default sat ✅ 0.04548 0.04546
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.05791 0.05837
MathSAT MathSAT-5.6.8_default sat ✅ 0.03010 0.03004
veriT veriT_default sat ✅ 0.01867 0.01871
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01897 0.00729
Z3 z3-4.8.17_default sat ✅ 0.02800 0.02981
z3-4.8.11_default sat ✅ 0.02949 0.02944
SMT-COMP 2025 cvc5 cvc5 sat ✅ 0.31277 0.18838
OpenSMT OpenSMT sat ✅ 0.29285 0.16478
SMTInterpol SMTInterpol sat ✅ 0.64902 1.19665
Yices2 Yices2 sat ✅ 0.29054 0.15900