Benchmark

non-incremental/QF_BV/rubik/7moves_mti_7-Atd_00004_bmc.smt2

Copyright 2010 Mentor Graphics Corporation
All Rights Reserved.
Redistribution and use in source and binary forms, with or without modification, are permitted provided
that the following conditions are met:
     *   Redistributions of source code must retain the above copyright notice, this list of conditions and
         the disclaimer below.
     *   Redistributions in binary form must reproduce the above copyright notice, this list of conditions
         and the disclaimer below in the documentation and/or other materials provided with the
         distribution.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDER "AS IS" AND ANY EXPRESS
OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER BE LIABLE FOR ANY
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH
DAMAGE.
Benchmark
Size244561
Compressed Size28177
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 244553
Compressed Size28029
Max. Term Depth4415
Asserts 32
Declared Functions0
Declared Constants52
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true82 false82 ite2027 not107
or1 and314 =398 let4413
concat14 extract89 bvxor21 bvult14
bvugt7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 4Simp 4Simp unsat ✅ 3.10000
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 205.20000
Boolector Boolector unsat ✅ 7.90000
CVC3 CVC3 v2.4.2 unknown ❌ 571.90000
CVC4 1.0rc.3931 unsat ✅ 334.70000
MathSAT MathSAT-HeavyBV unsat ✅ 5.60000
SONOLAR SONOLAR unsat ✅ 4.30000
Z3 Z3 unsat ✅ 5.20000
SMT Evaluation 2013 1.00 (0/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌
abziz_portfolio_2011_solvers_2 default unknown ❌
abziz_portfolio_2012_minfeatures default unknown ❌
abziz_portfolio_2012_solvers default unknown ❌
AbzizPortfolio-SMT-COMP-2012 default unknown ❌
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unknown ❌
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌
MathSAT5-SMT-COMP-2011 default unknown ❌
MathSAT5-SMT-COMP-2012 default unknown ❌
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2010 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
STP STP2-SMT-COMP-2011 default unknown ❌
STP2-SMT-COMP-2012 default unknown ❌
simplifyingSTP-SMT-COMP-2010 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 9.37556 9.37657
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 16.76370 33.53790
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 39.71420 79.48090
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 2.32831 2.32765
SMT-RAT SMT-RAT-final default unsat ✅ 196.51700 196.53300
STP stp-cryptominisat4 default unsat ✅ 6.09435 6.09607
stp-cmsat4-v15 default unsat ✅ 3.94249 3.94240
stp-cmsat4-mt-v15 default unknown ❌ 0.12761 0.12698
stp-minisat-v15 default unsat ✅ 2.74029 2.74058
Yices2 Yices default unsat ✅ 9.05127 9.05262
Z3 z3 4.4.0 default unsat ✅ 3.52924 3.53046
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 28.89130 28.89210
ABC_glucose glucose unsat ✅ 3.83894 3.84127
Boolector Boolector boolector unsat ✅ 4.90183 4.90457
Boolector preprop boolector unsat ✅ 4.92762 4.93038
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 51.26690 102.80100
MapleSTP MapleSTP default unsat ✅ 2.58964 2.59110
MapleSTP-mt default unsat ✅ 2.37129 9.09182
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 2.63479 2.63711
MinkeyRink Minkeyrink 2016 default unsat ✅ 4.21979 15.56700
Q3B Q3B default unsat ✅ 5.28706 15.30000
STP stp-cms-exp-2016 default unsat ✅ 3.05339 3.05479
stp-cms-mt-2016 default unsat ✅ 3.29836 12.80210
stp-cms-st-2016 default unsat ✅ 3.06974 3.07160
stp-minisat-st-2016 default unsat ✅ 21.41220 21.42450
Yices2 Yices-2.4.2 default unsat ✅ 8.96076 8.96584
Z3 z3-4.4.1 default unsat ✅ 3.00295 3.00621
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 12.05000 12.04910
Boolector SMT17 final boolector unsat ✅ 7.85233 7.85159
CVC4 CVC4-smtcomp2017-main default unsat ✅ 39.86420 79.87030
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 2.15430 2.14933
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 3.90162 3.96819
Q3B Q3B default unsat ✅ 8.65066 25.55000
STP stp_st default unsat ✅ 3.67404 3.67289
stp_mt default unsat ✅ 3.47412 13.26600
Yices2 Yices2-Main default unsat ✅ 7.60270 7.60141
Z3 z3-4.5.0 default unsat ✅ 3.39920 3.39905
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 11.85500 11.85410
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 6.27793 6.27613
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 2.24289 2.24400
MinkeyRink Minkeyrink MT_mt unsat ✅ 8.39819 32.84300
Minkeyrink ST_st unsat ✅ 8.15658 8.15633
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 9.11688 9.11335
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 9.08094 35.53160
STP-Riss-st-2018_riss-no-stderr unsat ✅ 2.86963 2.86922
Yices2 Yices 2.6.0_default unsat ✅ 9.46506 9.46526
Z3 z3-4.7.1_default unsat ✅ 3.07684 3.07683
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 3.20422 3.20393
Poolector-wrapped-sq_default unsat ✅ 3.41386 13.06000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 2.77094 2.77070
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.56769 3.56782
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 6.56004 25.52360
MinkeyRink ST-wrapped-sq_default unsat ✅ 7.74258 7.74244
Par4 Par4-wrapped-sq_default unsat ✅ 6.14471 18.32000
STP STP-2019-wrapped-sq_default unsat ✅ 8.68032 8.67772
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 10.99200 10.98650
stp-minisat-wrapped-sq_default unsat ✅ 2.42005 2.42015
stp-mt-wrapped-sq_default unsat ✅ 8.40088 32.81300
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 11.31480 22.87980
stp-riss-wrapped-sq_default unknown ❌ 0.16067 0.16088
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 10.19810 10.19730
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 3.61947 3.61942
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 9.20803 9.20669
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.56000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 16.64270 16.64280
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.72017 1.71998
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 4.11244 4.11220
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.57192 4.56997
STP STP 2022.4_default unsat ✅ 3.34086 3.34050
STP 2022.4_default unsat ✅ 3.33046 3.33042
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1233.95000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 7.46510 7.46477
Z3-Owl z3-Owl-Final_default unsat ✅ 8.95723 8.95662
z3-Owl-Final_default unsat ✅ 5.75666 5.75651
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 2.74812 2.64824
cvc5 cvc5 unsat ✅ 3.18795 3.08818
SMTInterpol SMTInterpol unsat ✅ 934.23132 1295.41780
STP STP unsat ✅ 4.03530 3.93526
Yices2 Yices2 unsat ✅ 3.76268 3.66274
Z3alpha Z3-alpha unsat ✅ 45.62293 45.51987