Benchmark

non-incremental/QF_BV/asp/Sokoban/duthen-990602.36.steps.10.asp.smt2 

Benchmark without description.
Benchmark
Size1280887
Compressed Size144827
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1280879
Compressed Size144832
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants16151
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true264 not9104 or2146 and7384
=>4532 =17791 bvsub2060 bvugt572
bvuge22

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.89 (1/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unsat ✅ 91.47630 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 23.25990 23.26850
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 21.76910 42.98550
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 22.54760 44.53020
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 33.95920 33.97480
SMT-RAT SMT-RAT-final default unsat ✅ 1143.70000 1144.12000
STP stp-cryptominisat4 default unsat ✅ 18.70540 18.70820
stp-cmsat4-v15 default unsat ✅ 20.38190 20.38490
stp-cmsat4-mt-v15 default unknown ❌ 1.56610 1.56576
stp-minisat-v15 default unsat ✅ 16.67360 16.67650
Yices2 Yices default unsat ✅ 16.97110 16.96640
Z3 z3 4.4.0 default unsat ✅ 6.55763 6.56000
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 483.02100 483.22400
ABC_glucose glucose unsat ✅ 24.94390 24.95730
Boolector Boolector boolector unsat ✅ 30.54260 30.56000
Boolector preprop boolector unsat ✅ 30.66910 30.68930
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 21.72120 42.90360
MapleSTP MapleSTP default unsat ✅ 40.05640 40.08010
MapleSTP-mt default unsat ✅ 87.18710 341.59000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 27.29690 27.31120
MinkeyRink Minkeyrink 2016 default unsat ✅ 9.02172 26.97840
Q3B Q3B default unknown ❌ 2400.06000 7203.76000
STP stp-cms-exp-2016 default unsat ✅ 25.97970 25.99400
stp-cms-mt-2016 default unsat ✅ 16.30410 60.27120
stp-cms-st-2016 default unsat ✅ 20.68060 20.69280
stp-minisat-st-2016 default unsat ✅ 82.69420 82.74860
Yices2 Yices-2.4.2 default unsat ✅ 16.52740 16.53680
Z3 z3-4.4.1 default unsat ✅ 6.22875 6.23429
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 13.14820 13.14690
Boolector SMT17 final boolector unsat ✅ 32.86690 32.86170
CVC4 CVC4-smtcomp2017-main default unsat ✅ 27.25820 53.99420
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 50.08320 50.07580
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 10.77510 12.71040
Q3B Q3B default unknown ❌ 600.06700 1786.25000
STP stp_st default unsat ✅ 30.75580 23.50240
stp_mt default unsat ✅ 18.70410 62.20010
Yices2 Yices2-Main default unsat ✅ 24.63300 24.63120
Z3 z3-4.5.0 default unsat ✅ 8.27645 8.26247
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 7.29237 7.29212
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 6.79951 6.79983
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 30.92010 30.91970
MinkeyRink Minkeyrink MT_mt unsat ✅ 7.23633 25.10170
Minkeyrink ST_st unsat ✅ 7.24275 7.24230
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 39.04370 39.03760
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 24.33850 84.70600
STP-Riss-st-2018_riss-no-stderr unsat ✅ 14.14630 14.14680
Yices2 Yices 2.6.0_default unsat ✅ 18.68380 18.68240
Z3 z3-4.7.1_default unsat ✅ 11.85860 11.85820
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 5.46037 5.45966
MathSAT mathsat-5.6.6_default unsat ✅ 158.32500 158.29700
STP STP 2021.0_default unsat ✅ 34.32040 99.06760
Z3 z3-4.8.11_default unsat ✅ 7.34994 7.34982
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 5.90408 5.90246
Bitwuzla-wrapped_default unsat ✅ 5.94591 5.94335
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 19.41140 19.41070
MathSAT MathSAT-5.6.8_default unsat ✅ 145.46600 145.44700
STP STP 2022.4_default unsat ✅ 5.94000 5.93982
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 4.64426 4.64407
Z3++BV z3++bv_0702_default unsat ✅ 5.04841 5.04781
Z3 z3-4.8.17_default unsat ✅ 5.96196 5.96293
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 8.95239 8.94328
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 17.47830 17.47850
STP STP 2022.4_default unsat ✅ 4.77058 4.77049
STP 2022.4_default unsat ✅ 4.75571 4.75546
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1245.91000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 20.40720 20.40330
Z3-Owl z3-Owl-Final_default unsat ✅ 18.83940 18.71730
z3-Owl-Final_default unsat ✅ 14.38310 14.38120
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 5.28490 5.18481
cvc5 cvc5 unsat ✅ 13.80739 13.70733
SMTInterpol SMTInterpol unknown ❌ 1201.71902 1295.44929
STP STP unsat ✅ 3.99955 3.89912
Yices2 Yices2 unsat ✅ 4.09620 3.99626
Z3alpha Z3-alpha unsat ✅ 162.12411 162.01650
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 3.52588 3.39390
Bitwuzla-MachBV-base unsat ✅ 4.37419 4.25415
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 4.14592 4.01265
BVDecide bv_decide unknown ❌ 1201.39612 1200.98722
bv_decide-nokernel unsat ✅ 322.16916 321.98263
cvc5 cvc5 unsat ✅ 10.76763 10.64474
SMTInterpol SMTInterpol unknown ❌ 1201.77338 1254.96988
Yices2 Yices2 unsat ✅ 3.50568 3.38164
Z3alpha Z3-alpha unsat ✅ 12.73209 48.46803
Z3 Z3-alpha-base unsat ✅ 4.73752 4.60799
Z3-Owl-base unsat ✅ 18.28875 18.15677
z3siri-base unsat ✅ 4.77176 4.63599
Z3-Owl Z3-Owl unsat ✅ 10.30735 10.18662