Benchmark

non-incremental/QF_BV/rubik/6moves_mti_7-Atd_00004_bmc.smt2 

Copyright 2010 Mentor Graphics Corporation
All Rights Reserved.
Redistribution and use in source and binary forms, with or without modification, are permitted provided
that the following conditions are met:
     *   Redistributions of source code must retain the above copyright notice, this list of conditions and
         the disclaimer below.
     *   Redistributions in binary form must reproduce the above copyright notice, this list of conditions
         and the disclaimer below in the documentation and/or other materials provided with the
         distribution.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDER "AS IS" AND ANY EXPRESS
OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER BE LIABLE FOR ANY
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH
DAMAGE.
Benchmark
Size244559
Compressed Size27413
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 244551
Compressed Size27944
Max. Term Depth4415
Asserts 32
Declared Functions0
Declared Constants52
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true82 false82 ite2027 not107
or1 and314 =398 let4413
concat14 extract89 bvxor21 bvult14
bvugt7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.22 (7/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 0.57233 —
abziz_portfolio_2011_solvers_2 default sat ✅ 0.58815 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default sat ✅ 0.56398 —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 2.39935 —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default sat ✅ 0.60751 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 296.48300 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default sat ✅ 309.47200 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 5.13332 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.45625 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 0.43107 —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default sat ✅ 0.73369 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.91217 —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default sat ✅ 0.42704 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 1.17292 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.68202 —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.13101 3.13052
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 4.77306 9.46756
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 26.04450 52.11910
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 0.81216 0.81188
SMT-RAT SMT-RAT-final default sat ✅ 112.65900 112.66800
STP stp-cryptominisat4 default sat ✅ 1.84541 1.84472
stp-cmsat4-v15 default sat ✅ 0.42834 0.42693
stp-cmsat4-mt-v15 default unknown ❌ 0.12777 0.12698
stp-minisat-v15 default sat ✅ 0.98702 0.98585
Yices2 Yices default sat ✅ 2.19242 2.19167
Z3 z3 4.4.0 default sat ✅ 2.38609 2.38664
SMT-COMP 2016 ABC ABC_default default_abc sat ✅ 2.15533 2.14180
ABC_glucose glucose sat ✅ 2.11587 2.11738
Boolector Boolector boolector sat ✅ 1.86603 1.86723
Boolector preprop boolector sat ✅ 1.89440 1.89561
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 3.26997 6.45757
MapleSTP MapleSTP default sat ✅ 1.37103 1.37178
MapleSTP-mt default sat ✅ 1.17094 4.33106
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2.06768 2.06826
MinkeyRink Minkeyrink 2016 default sat ✅ 1.21847 3.66337
Q3B Q3B default sat ✅ 1.66387 4.47000
STP stp-cms-exp-2016 default sat ✅ 0.58111 0.58135
stp-cms-mt-2016 default sat ✅ 0.44294 1.42305
stp-cms-st-2016 default sat ✅ 0.55557 0.55590
stp-minisat-st-2016 default sat ✅ 4.52793 4.53088
Yices2 Yices-2.4.2 default sat ✅ 0.53034 0.52993
Z3 z3-4.4.1 default sat ✅ 1.00519 1.00696
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 8.30232 8.30109
Boolector SMT17 final boolector sat ✅ 2.43590 2.43532
CVC4 CVC4-smtcomp2017-main default sat ✅ 8.66490 17.27190
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 0.75547 0.75548
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.15224 1.15746
Q3B Q3B default sat ✅ 5.06321 14.65000
STP stp_st default sat ✅ 1.50265 1.50163
stp_mt default sat ✅ 0.46405 1.33921
Yices2 Yices2-Main default sat ✅ 2.88095 2.88027
Z3 z3-4.5.0 default sat ✅ 3.41254 3.41067
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.64300 1.64279
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 1.75291 1.75229
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.36756 1.36838
MinkeyRink Minkeyrink MT_mt sat ✅ 0.47407 1.40089
Minkeyrink ST_st sat ✅ 0.45537 0.45555
STP STP-CMS-st-2018_default-no-stderr sat ✅ 2.09920 2.09901
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 1.28314 4.62904
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.45127 2.44948
Yices2 Yices 2.6.0_default sat ✅ 0.11475 0.11471
Z3 z3-4.7.1_default sat ✅ 1.30974 1.30962
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 3.03768 3.03717
Poolector-wrapped-sq_default sat ✅ 1.10824 4.02000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 2.33285 2.33271
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 1.56445 1.56460
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.46720 1.35995
MinkeyRink ST-wrapped-sq_default sat ✅ 1.88058 1.88056
Par4 Par4-wrapped-sq_default sat ✅ 1.32625 3.89000
STP STP-2019-wrapped-sq_default sat ✅ 2.01332 2.01354
stp-mergesat-fixed-wrapped-sq_default sat ✅ 9.53425 9.53369
stp-minisat-wrapped-sq_default sat ✅ 0.25906 0.25928
stp-mt-wrapped-sq_default sat ✅ 0.48668 1.43220
stp-portfolio-fixed-wrapped-sq_default sat ✅ 9.58764 11.57030
stp-riss-wrapped-sq_default unknown ❌ 0.15984 0.16003
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 1.40121 1.40115
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.62155 2.62153
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 2.68172 2.68151
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.86000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 3.02401 3.02383
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.66717 1.66711
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 1.52408 1.52386
Bitwuzla-wrapped_default sat ✅ 1.61761 1.61750
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 2.14533 2.14590
MathSAT MathSAT-5.6.8_default sat ✅ 2.10893 2.10865
STP STP 2022.4_default sat ✅ 1.69529 1.69509
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.53508 1.53488
Z3++BV z3++bv_0702_default sat ✅ 1.87812 1.87790
Z3 z3-4.8.17_default sat ✅ 1.43229 1.43398
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.93575 1.93570
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 2.83702 2.83734
STP STP 2022.4_default sat ✅ 1.69817 1.69794
STP 2022.4_default sat ✅ 1.68662 1.68642
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.11000 1230.30000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 2.94597 2.94552
Z3-Owl z3-Owl-Final_default sat ✅ 3.26496 3.26448
z3-Owl-Final_default sat ✅ 4.62320 4.62284
SMT-COMP 2024 Bitwuzla Bitwuzla sat ✅ 0.79506 0.69479
cvc5 cvc5 sat ✅ 1.49359 1.39403
SMTInterpol SMTInterpol sat ✅ 343.10675 391.93198
STP STP sat ✅ 3.23217 3.13262
Yices2 Yices2 sat ✅ 3.74024 3.63905
Z3alpha Z3-alpha sat ✅ 12.69766 12.59743