Benchmark

non-incremental/QF_BV/asp/Sokoban/duthen-990602.50.steps.9.asp.smt2

Benchmark without description.
Benchmark
Size1204852
Compressed Size137617
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1204844
Compressed Size137623
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants15272
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true264 not8159 or1952 and7312
=>4112 =16823 bvsub1872 bvugt502
bvuge20

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.89 (1/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 12.47930
abziz_portfolio_2011_solvers_2 default unknown ❌
abziz_portfolio_2012_minfeatures default unknown ❌
abziz_portfolio_2012_solvers default unknown ❌
AbzizPortfolio-SMT-COMP-2012 default unknown ❌
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌
Boolector-SMT-COMP-2011 default unknown ❌
Boolector-SMT-COMP-2012 default unknown ❌
CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌
MathSAT5-SMT-COMP-2011 default unknown ❌
MathSAT5-SMT-COMP-2012 default unknown ❌
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌
SONOLAR-SMT-COMP-2010 default unknown ❌
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unknown ❌
STP STP2-SMT-COMP-2011 default unknown ❌
STP2-SMT-COMP-2012 default unknown ❌
simplifyingSTP-SMT-COMP-2010 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 22.81670 22.82450
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 85.33000 170.71000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 35.15000 69.86540
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 34.20470 34.21780
SMT-RAT SMT-RAT-final default unsat ✅ 920.34400 920.64900
STP stp-cryptominisat4 default unsat ✅ 23.06770 23.07650
stp-cmsat4-v15 default unsat ✅ 35.77450 35.78860
stp-cmsat4-mt-v15 default unknown ❌ 1.52338 1.52277
stp-minisat-v15 default unsat ✅ 25.23830 25.25020
Yices2 Yices default unsat ✅ 10.91300 10.91430
Z3 z3 4.4.0 default unsat ✅ 6.07262 6.07508
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 375.52300 375.68400
ABC_glucose glucose unsat ✅ 21.87470 21.88720
Boolector Boolector boolector unsat ✅ 28.44050 28.45670
Boolector preprop boolector unsat ✅ 28.76690 28.78330
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 40.21200 80.06850
MapleSTP MapleSTP default unsat ✅ 191.83900 191.93200
MapleSTP-mt default unsat ✅ 496.28500 1965.12000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 27.62610 27.64290
MinkeyRink Minkeyrink 2016 default unsat ✅ 11.93820 38.61580
Q3B Q3B default unknown ❌ 2400.03000 7204.06000
STP stp-cms-exp-2016 default unsat ✅ 53.14010 53.17150
stp-cms-mt-2016 default unsat ✅ 45.79930 177.26700
stp-cms-st-2016 default unsat ✅ 51.14200 51.17540
stp-minisat-st-2016 default unsat ✅ 166.74900 166.84500
Yices2 Yices-2.4.2 default unsat ✅ 20.94060 20.94100
Z3 z3-4.4.1 default unsat ✅ 4.42003 4.42375
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 10.92260 10.92090
Boolector SMT17 final boolector unsat ✅ 34.27760 34.27720
CVC4 CVC4-smtcomp2017-main default unsat ✅ 128.83800 100.28300
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 44.83040 44.81980
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 3.85375 3.86402
Q3B Q3B default unknown ❌ 600.03500 1799.45000
STP stp_st default unsat ✅ 23.56910 23.56490
stp_mt default unsat ✅ 21.22300 68.64300
Yices2 Yices2-Main default unsat ✅ 11.05600 11.05270
Z3 z3-4.5.0 default unsat ✅ 7.33963 7.33838
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 5.29851 5.29616
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.25155 5.25147
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 32.30770 32.30530
MinkeyRink Minkeyrink MT_mt unsat ✅ 4.95111 16.04800
Minkeyrink ST_st unsat ✅ 5.23647 5.23670
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 41.86460 41.86430
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 49.22610 174.44200
STP-Riss-st-2018_riss-no-stderr unsat ✅ 14.97310 14.97280
Yices2 Yices 2.6.0_default unsat ✅ 10.48220 10.48210
Z3 z3-4.7.1_default unsat ✅ 12.14670 12.14520
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 5.38565 5.38520
Boolector Boolector-wrapped-sq_default unsat ✅ 6.81280 6.81208
Poolector-wrapped-sq_default unsat ✅ 9.60684 37.43890
CVC4 CVC4-sq-final_default unsat ✅ 6.84612 6.84586
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.06000 1199.97000
MathSAT MathSAT5_default.sh unsat ✅ 407.41300 407.40000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.13385 1.13405
MinkeyRink Solver 2020.3_default unsat ✅ 5.03900 16.40900
STP STP_default unsat ✅ 36.51570 110.55000
STP ++ Mergsat v1_default unsat ✅ 36.69670 36.69530
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.51386 1.51377
Z3 z3-4.8.8_default unsat ✅ 11.78240 11.78100
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 5.37369 5.37372
MathSAT mathsat-5.6.6_default unsat ✅ 508.40500 508.21200
STP STP 2021.0_default unsat ✅ 42.56100 141.02000
Z3 z3-4.8.11_default unsat ✅ 8.22997 8.23016
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 5.73704 5.73572
Bitwuzla-wrapped_default unsat ✅ 5.25695 5.25687
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 23.80630 23.80600
MathSAT MathSAT-5.6.8_default unsat ✅ 616.10900 615.97900
STP STP 2022.4_default unsat ✅ 4.25726 4.25736
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 4.08459 4.08072
Z3++BV z3++bv_0702_default unsat ✅ 4.42935 4.42912
Z3 z3-4.8.17_default unsat ✅ 7.75318 7.75515