Benchmark

non-incremental/QF_BV/asp/Sokoban/duthen-990602.50.steps.10.asp.smt2 

Benchmark without description.
Benchmark
Size1346718
Compressed Size151302
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1346710
Compressed Size151310
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants17040
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true266 not9116 or2204 and8206
=>4555 =18755 bvsub2070 bvugt568
bvuge22

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 16.52270 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 14.15860 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 699.80000 —
abziz_portfolio_2012_minfeatures default unsat ✅ 23.47420 —
abziz_portfolio_2012_solvers default unsat ✅ 13.95130 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 13.91980 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 23.71920 —
Boolector-SMT-COMP-2011 default unsat ✅ 35.88400 —
Boolector-SMT-COMP-2012 default unsat ✅ 38.21150 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 132.16500 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 122.54400 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 308.79800 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 645.53500 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 889.52800 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 43.97980 —
SONOLAR-SMT-COMP-2010 default unknown ❌ 40.14100 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 47.70320 —
STP STP2-SMT-COMP-2011 default unsat ✅ 32.64360 —
STP2-SMT-COMP-2012 default unsat ✅ 14.98200 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 45.93980 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 5.81044 —
Z3-SMT-COMP-2011 default unsat ✅ 6.61055 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 28.42310 28.43370
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 136.11900 272.73300
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 63.28420 126.24500
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 52.41760 52.43800
SMT-RAT SMT-RAT-final default unsat ✅ 1745.80000 1746.44000
STP stp-cryptominisat4 default unsat ✅ 30.51780 30.52940
stp-cmsat4-v15 default unsat ✅ 40.71510 40.72280
stp-cmsat4-mt-v15 default unknown ❌ 1.83169 1.83072
stp-minisat-v15 default unsat ✅ 33.61480 33.62090
Yices2 Yices default unsat ✅ 13.69330 13.69790
Z3 z3 4.4.0 default unsat ✅ 7.19601 7.19390
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 487.20800 487.49200
ABC_glucose glucose unsat ✅ 25.28450 25.27560
Boolector Boolector boolector unsat ✅ 69.20740 69.23840
Boolector preprop boolector unsat ✅ 34.90140 34.92120
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 49.96490 99.57090
MapleSTP MapleSTP default unknown ❌ 2400.02000 2401.59000
MapleSTP-mt default unsat ✅ 830.04000 3289.89000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 45.62990 45.65570
MinkeyRink Minkeyrink 2016 default unsat ✅ 15.68360 51.87750
Q3B Q3B default unknown ❌ 2400.09000 7204.44000
STP stp-cms-exp-2016 default unsat ✅ 170.62100 170.69800
stp-cms-mt-2016 default unsat ✅ 49.41350 191.09600
stp-cms-st-2016 default unsat ✅ 70.81650 70.85640
stp-minisat-st-2016 default unsat ✅ 234.87700 235.01400
Yices2 Yices-2.4.2 default unsat ✅ 16.77090 16.78050
Z3 z3-4.4.1 default unsat ✅ 6.92007 6.92520
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 19.03070 19.03010
Boolector SMT17 final boolector unsat ✅ 43.87600 43.87350
CVC4 CVC4-smtcomp2017-main default unsat ✅ 54.08890 107.78600
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 59.50160 59.49180
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 3.90512 3.96551
Q3B Q3B default unknown ❌ 600.04400 1785.29000
STP stp_st default unsat ✅ 25.40890 25.40840
stp_mt default unsat ✅ 31.30870 86.12390
Yices2 Yices2-Main default unsat ✅ 19.38530 19.38510
Z3 z3-4.5.0 default unsat ✅ 10.22180 10.21300
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 6.77313 6.77251
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 6.81647 6.81417
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 46.17900 46.17310
MinkeyRink Minkeyrink MT_mt unsat ✅ 7.90707 27.15220
Minkeyrink ST_st unsat ✅ 8.07876 8.07808
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 43.46110 43.45720
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 46.44180 166.36800
STP-Riss-st-2018_riss-no-stderr unsat ✅ 21.43970 21.43430
Yices2 Yices 2.6.0_default unsat ✅ 15.00500 15.00450
Z3 z3-4.7.1_default unsat ✅ 13.63770 13.63630
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 8.04326 8.04257
Poolector-wrapped-sq_default unsat ✅ 11.30350 44.30000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 12.56860 12.56670
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 8.26322 8.26214
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 6.33360 21.07900
MinkeyRink ST-wrapped-sq_default unsat ✅ 6.12873 6.12824
Par4 Par4-wrapped-sq_default unsat ✅ 7.49207 22.24000
STP STP-2019-wrapped-sq_default unsat ✅ 29.27800 29.27970
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 45.16890 45.15760
stp-minisat-wrapped-sq_default unsat ✅ 45.10640 45.10270
stp-mt-wrapped-sq_default unsat ✅ 42.44450 137.47000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 53.05670 128.06800
stp-riss-wrapped-sq_default unknown ❌ 4.91891 4.91825
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 16.88040 16.88090
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 6.80543 6.80502
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 9.13663 9.13580
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.66000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 10.26600 10.26660
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 7.88893 7.88866
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 7.18594 7.18581
MathSAT mathsat-5.6.6_default unsat ✅ 813.78100 813.70300
STP STP 2021.0_default unsat ✅ 39.95600 135.87800
Z3 z3-4.8.11_default unsat ✅ 6.66404 6.66340
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 6.35843 6.35844
Bitwuzla-wrapped_default unsat ✅ 6.30759 6.30706
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 26.14720 26.14620
MathSAT MathSAT-5.6.8_default unsat ✅ 449.84800 449.76800
STP STP 2022.4_default unsat ✅ 4.68891 4.68861
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 4.34241 4.34200
Z3++BV z3++bv_0702_default unsat ✅ 5.12212 5.12183
Z3 z3-4.8.17_default unsat ✅ 17.32200 17.32290
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 6.69163 6.58852
cvc5 cvc5 unsat ✅ 20.28294 20.17431
SMTInterpol SMTInterpol unknown ❌ 1201.71984 1326.93757
STP STP unsat ✅ 4.62059 4.52068
Yices2 Yices2 unsat ✅ 4.88235 4.77990
Z3alpha Z3-alpha unsat ✅ 151.53121 151.42903
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 3.95182 3.83691
Bitwuzla-MachBV-base unsat ✅ 4.90924 4.78387
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 4.75302 4.62621
BVDecide bv_decide unknown ❌ 1201.39563 1200.90831
bv_decide-nokernel unsat ✅ 334.83422 334.61140
cvc5 cvc5 unsat ✅ 17.05731 16.92778
SMTInterpol SMTInterpol unknown ❌ 1201.48896 1249.65054
Yices2 Yices2 unsat ✅ 4.31376 4.19330
Z3alpha Z3-alpha unsat ✅ 18.95307 73.22982
Z3 Z3-alpha-base unsat ✅ 8.01566 7.89541
Z3-Owl-base unsat ✅ 30.47699 30.34842
z3siri-base unsat ✅ 8.18774 8.06686
Z3-Owl Z3-Owl unsat ✅ 9.30171 9.17940