Benchmark

non-incremental/QF_BV/rubik/8moves_mti_8-Atd_00004_bmc.smt2 

Copyright 2010 Mentor Graphics Corporation
All Rights Reserved.
Redistribution and use in source and binary forms, with or without modification, are permitted provided
that the following conditions are met:
     *   Redistributions of source code must retain the above copyright notice, this list of conditions and
         the disclaimer below.
     *   Redistributions in binary form must reproduce the above copyright notice, this list of conditions
         and the disclaimer below in the documentation and/or other materials provided with the
         distribution.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDER "AS IS" AND ANY EXPRESS
OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER BE LIABLE FOR ANY
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH
DAMAGE.
Benchmark
Size282572
Compressed Size29164
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 282564
Compressed Size29149
Max. Term Depth5104
Asserts 33
Declared Functions0
Declared Constants56
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true95 false95 ite2359 not123
or1 and361 =454 let5102
concat16 extract103 bvxor24 bvult16
bvugt8

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 0.14 (6/7) 4Simp 4Simp unsat ✅ 37.90000 —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 365.90000 —
Boolector Boolector unsat ✅ 115.80000 —
CVC3 CVC3 v2.4.2 unknown ❌ 773.60000 —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
MathSAT MathSAT-HeavyBV unsat ✅ 83.00000 —
SONOLAR SONOLAR unsat ✅ 87.60000 —
Z3 Z3 unsat ✅ 165.70000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 25.61690 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 318.41000 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 90.84230 —
abziz_portfolio_2012_minfeatures default unsat ✅ 94.40390 —
abziz_portfolio_2012_solvers default unsat ✅ 33.88960 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 70.25600 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 77.96210 —
Boolector-SMT-COMP-2011 default unsat ✅ 64.55310 —
Boolector-SMT-COMP-2012 default unsat ✅ 88.69900 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 730.58000 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 189.74000 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 59.86530 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 34.60620 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 85.96590 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 93.08060 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 46.69990 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 156.64200 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 48.90660 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 67.16300 —
STP STP2-SMT-COMP-2011 default unsat ✅ 313.53800 —
STP2-SMT-COMP-2012 default unsat ✅ 30.13130 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 33.83930 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 57.95440 —
Z3-SMT-COMP-2011 default unsat ✅ 80.25730 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 326.00900 326.07100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 803.13500 1612.78000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 258.53400 518.61500
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 29.85630 29.86950
SMT-RAT SMT-RAT-final default unsat ✅ 1991.92000 1992.78000
STP stp-cryptominisat4 default unsat ✅ 93.30570 93.35180
stp-cmsat4-v15 default unsat ✅ 34.96620 34.98270
stp-cmsat4-mt-v15 default unknown ❌ 0.14671 0.14598
stp-minisat-v15 default unsat ✅ 59.08870 59.11800
Yices2 Yices default unsat ✅ 173.81700 173.88700
Z3 z3 4.4.0 default unsat ✅ 76.39960 76.43240
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 195.41400 195.51900
ABC_glucose glucose unsat ✅ 32.13560 32.15300
Boolector Boolector boolector unsat ✅ 206.67300 206.79900
Boolector preprop boolector unsat ✅ 206.38300 206.51200
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 285.48400 573.10700
MapleSTP MapleSTP default unsat ✅ 423.37200 423.60100
MapleSTP-mt default unsat ✅ 219.51000 874.52900
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 24.03660 24.04550
MinkeyRink Minkeyrink 2016 default unsat ✅ 43.17420 170.40300
Q3B Q3B default unsat ✅ 18.10830 54.01000
STP stp-cms-exp-2016 default unsat ✅ 33.51290 33.53310
stp-cms-mt-2016 default unsat ✅ 36.45040 144.50700
stp-cms-st-2016 default unsat ✅ 36.03130 36.04980
stp-minisat-st-2016 default unsat ✅ 382.59300 382.83900
Yices2 Yices-2.4.2 default unsat ✅ 237.87300 238.02800
Z3 z3-4.4.1 default unsat ✅ 85.74050 85.79110
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 349.43000 349.36900
Boolector SMT17 final boolector unsat ✅ 198.27400 198.24700
CVC4 CVC4-smtcomp2017-main default unsat ✅ 250.59400 503.42200
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 25.32430 25.30770
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 39.94680 75.60000
Q3B Q3B default unsat ✅ 28.43070 76.01000
STP stp_st default unsat ✅ 37.92230 37.92000
stp_mt default unsat ✅ 37.46120 148.39500
Yices2 Yices2-Main default unsat ✅ 257.27500 257.28400
Z3 z3-4.5.0 default unsat ✅ 65.32030 65.31890
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 358.32100 358.30800
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 160.76200 160.74900
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 32.11160 32.11010
MinkeyRink Minkeyrink MT_mt unsat ✅ 57.82120 228.49000
Minkeyrink ST_st unsat ✅ 64.50440 64.48880
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 64.69530 64.69650
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 54.65640 216.85400
STP-Riss-st-2018_riss-no-stderr unsat ✅ 42.82480 42.82270
Yices2 Yices 2.6.0_default unsat ✅ 175.07700 175.05800
Z3 z3-4.7.1_default unsat ✅ 62.57110 62.57050
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 34.70670 34.70120
Boolector Boolector-wrapped-sq_default unsat ✅ 42.33220 42.33100
Poolector-wrapped-sq_default unsat ✅ 46.27200 182.95000
CVC4 CVC4-sq-final_default unsat ✅ 44.84060 44.81440
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.84000
MathSAT MathSAT5_default.sh unsat ✅ 87.19940 87.19250
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.16658 0.16683
MinkeyRink Solver 2020.3_default unsat ✅ 70.04150 277.82800
STP STP_default unsat ✅ 77.51080 307.62700
STP ++ Mergsat v1_default unsat ✅ 97.48460 97.46320
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 44.83140 44.82580
Z3 z3-4.8.8_default unsat ✅ 40.13800 80.23920
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 31.70190 31.69440
Bitwuzla-wrapped_default unsat ✅ 40.28880 40.28540
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 54.74830 54.74780
MathSAT MathSAT-5.6.8_default unsat ✅ 78.84000 78.81660
STP STP 2022.4_default unsat ✅ 45.56900 45.56630
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 59.21640 59.20670
Z3++BV z3++bv_0702_default unsat ✅ 69.24180 69.23570
Z3 z3-4.8.17_default unsat ✅ 94.01600 94.01160
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 67.50010 67.49530
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 46.97160 46.96170
STP STP 2022.4_default unsat ✅ 38.46120 38.45350
STP 2022.4_default unsat ✅ 38.64420 38.64170
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1232.40000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 256.02000 256.00700
Z3-Owl z3-Owl-Final_default unsat ✅ 314.21600 314.16000
z3-Owl-Final_default unsat ✅ 83.26770 83.21020
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 53.31071 53.18267
cvc5 cvc5 unsat ✅ 28.21404 28.10148
SMTInterpol SMTInterpol unknown ❌ 1201.74462 1273.83057
STP STP unsat ✅ 48.40189 48.28485
Yices2 Yices2 unsat ✅ 57.15624 57.05516
Z3alpha Z3-alpha unsat ✅ 265.65418 265.51927