Benchmark

non-incremental/QF_BV/rubik/8moves_mti_9-Atd_00004_bmc.smt2 

Copyright 2010 Mentor Graphics Corporation
All Rights Reserved.
Redistribution and use in source and binary forms, with or without modification, are permitted provided
that the following conditions are met:
     *   Redistributions of source code must retain the above copyright notice, this list of conditions and
         the disclaimer below.
     *   Redistributions in binary form must reproduce the above copyright notice, this list of conditions
         and the disclaimer below in the documentation and/or other materials provided with the
         distribution.
THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDER "AS IS" AND ANY EXPRESS
OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER BE LIABLE FOR ANY
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY
OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH
DAMAGE.
Benchmark
Size320581
Compressed Size32026
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 320573
Compressed Size32035
Max. Term Depth5793
Asserts 34
Declared Functions0
Declared Constants60
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true108 false108 ite2691 not139
or1 and408 =510 let5791
concat18 extract117 bvxor27 bvult18
bvugt9

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.22 (7/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 87.22060 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 72.80290 —
abziz_portfolio_2011_solvers_2 default sat ✅ 72.46410 —
abziz_portfolio_2012_minfeatures default sat ✅ 57.72200 —
abziz_portfolio_2012_solvers default sat ✅ 8.98042 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 20.91120 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 547.99600 —
Boolector-SMT-COMP-2011 default sat ✅ 15.53230 —
Boolector-SMT-COMP-2012 default sat ✅ 4.02404 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 811.47200 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 207.57600 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 119.11900 —
MathSAT5-SMT-COMP-2011 default sat ✅ 63.70410 —
MathSAT5-SMT-COMP-2012 default sat ✅ 266.65900 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 20.33050 —
SONOLAR-SMT-COMP-2010 default sat ✅ 24.97330 —
SONOLAR-SMT-COMP-2011 default sat ✅ 14.95730 —
SONOLAR-SMT-COMP-2012 default sat ✅ 19.41160 —
STP STP2-SMT-COMP-2011 default sat ✅ 1085.06000 —
STP2-SMT-COMP-2012 default sat ✅ 3.28047 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 76.22100 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default sat ✅ 50.32440 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 490.98900 491.17700
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 385.07700 772.83600
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 136.15900 272.94200
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 87.31980 87.35070
SMT-RAT SMT-RAT-final default sat ✅ 1354.59000 1355.02000
STP stp-cryptominisat4 default sat ✅ 1037.10000 1037.33000
stp-cmsat4-v15 default sat ✅ 99.70990 99.74680
stp-cmsat4-mt-v15 default unknown ❌ 0.16854 0.16697
stp-minisat-v15 default sat ✅ 10.86450 10.86830
Yices2 Yices default sat ✅ 347.38800 347.55800
Z3 z3 4.4.0 default sat ✅ 148.05900 148.12200
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 255.16300 255.30100
ABC_glucose glucose sat ✅ 223.06900 223.20800
Boolector Boolector boolector unknown ❌ 2400.01000 2401.39000
Boolector preprop boolector unknown ❌ 2400.01000 2401.32000
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 136.04500 273.05500
MapleSTP MapleSTP default sat ✅ 51.52480 51.55900
MapleSTP-mt default sat ✅ 202.45000 806.71100
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 80.25910 80.29060
MinkeyRink Minkeyrink 2016 default sat ✅ 20.39300 79.52370
Q3B Q3B default sat ✅ 33.16720 99.01000
STP stp-cms-exp-2016 default sat ✅ 38.64540 38.66410
stp-cms-mt-2016 default sat ✅ 15.53790 61.48330
stp-cms-st-2016 default sat ✅ 32.36780 32.38430
stp-minisat-st-2016 default sat ✅ 258.13400 258.27700
Yices2 Yices-2.4.2 default sat ✅ 22.23980 22.25340
Z3 z3-4.4.1 default sat ✅ 1831.68000 1832.72000
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.06100 599.98600
Boolector SMT17 final boolector unknown ❌ 600.01700 599.95600
CVC4 CVC4-smtcomp2017-main default sat ✅ 336.82100 676.83300
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 15.72370 15.72200
MinkeyRink MinkeyRink 2017.3a default sat ✅ 47.15110 90.22000
Q3B Q3B default sat ✅ 29.39490 87.84000
STP stp_st default sat ✅ 145.23900 145.22300
stp_mt default sat ✅ 16.40400 64.60320
Yices2 Yices2-Main default sat ✅ 23.11640 23.11660
Z3 z3-4.5.0 default unknown ❌ 600.02400 600.03900
SMT-COMP 2018 Boolector Boolector_default sat ✅ 123.83300 123.82900
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 219.80000 219.79800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 167.11900 167.12800
MinkeyRink Minkeyrink MT_mt sat ✅ 234.57100 932.61900
Minkeyrink ST_st sat ✅ 187.68900 187.66400
STP STP-CMS-st-2018_default-no-stderr sat ✅ 317.66500 317.62100
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 129.37600 513.17200
STP-Riss-st-2018_riss-no-stderr sat ✅ 5.73515 5.73508
Yices2 Yices 2.6.0_default sat ✅ 21.87570 21.87630
Z3 z3-4.7.1_default sat ✅ 34.99130 34.99020
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 83.24130 83.22180
Poolector-wrapped-sq_default sat ✅ 99.05710 392.22000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 181.51500 181.50200
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 17.80130 17.80180
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 293.34100 1164.85000
MinkeyRink ST-wrapped-sq_default sat ✅ 552.56700 552.50700
Par4 Par4-wrapped-sq_default sat ✅ 30.14750 90.23000
STP STP-2019-wrapped-sq_default sat ✅ 243.30600 243.28200
stp-mergesat-fixed-wrapped-sq_default sat ✅ 99.34680 99.34430
stp-minisat-wrapped-sq_default sat ✅ 41.14190 41.13710
stp-mt-wrapped-sq_default sat ✅ 49.27050 195.00500
stp-portfolio-fixed-wrapped-sq_default sat ✅ 253.82000 398.04500
stp-riss-wrapped-sq_default unknown ❌ 0.21025 0.21046
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 64.90440 64.89120
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 192.05800 192.04900
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 16.16340 16.16350
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.68000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 81.32340 81.31580
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 73.09590 73.09350
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 87.61578 87.47929
cvc5 cvc5 sat ✅ 146.86517 146.75993
SMTInterpol SMTInterpol unknown ❌ 1201.72001 1258.06037
STP STP sat ✅ 110.32040 110.20366
Yices2 Yices2 sat ✅ 121.54559 121.39233
Z3alpha Z3-alpha sat ✅ 186.06944 185.96626
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 3.98634 3.85618
Bitwuzla-MachBV-base sat ✅ 59.13259 59.00918
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 4.75224 4.62304
BVDecide bv_decide sat ✅ 55.44252 55.27659
bv_decide-nokernel sat ✅ 55.48234 55.30938
cvc5 cvc5 sat ✅ 101.87083 101.73991
SMTInterpol SMTInterpol unknown ❌ 1201.44474 1240.02188
Yices2 Yices2 sat ✅ 60.85298 60.71509
Z3alpha Z3-alpha sat ✅ 109.61147 436.90359
Z3 Z3-alpha-base sat ✅ 17.47883 17.34723
Z3-Owl-base sat ✅ 71.15787 71.03183
z3siri-base sat ✅ 17.63768 17.51532
Z3-Owl Z3-Owl sat ✅ 57.06138 56.91597