Benchmark

non-incremental/QF_BV/asp/Sokoban/duthen-990602.77.steps.9.asp.smt2 

Benchmark without description.
Benchmark
Size1231144
Compressed Size141256
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1231136
Compressed Size141261
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants15600
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true278 not8432 or2026 and7381
=>4137 =17149 bvsub1884 bvugt538
bvuge20

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 7.28338 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 1.95469 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 1.93184 —
abziz_portfolio_2012_minfeatures default unsat ✅ 1.97334 —
abziz_portfolio_2012_solvers default unsat ✅ 1.97519 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 2.02034 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 12.19730 —
Boolector-SMT-COMP-2011 default unsat ✅ 24.48790 —
Boolector-SMT-COMP-2012 default unsat ✅ 13.25010 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1134.44000 —
CVC3-SMT-COMP-2011 default unsat ✅ 1051.96000 —
CVC3-SMT-COMP-2012 default unsat ✅ 1031.57000 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 84.17230 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 42.58210 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 23.82850 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 55.13600 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 69.34890 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 23.48170 —
SONOLAR-SMT-COMP-2010 default unknown ❌ 15.93650 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 14.28620 —
STP STP2-SMT-COMP-2011 default unsat ✅ 6.61605 —
STP2-SMT-COMP-2012 default unsat ✅ 13.13180 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 13.87140 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1.98603 —
Z3-SMT-COMP-2011 default unsat ✅ 1.96790 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 12.22840 12.23110
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 18.66250 36.77440
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 14.47990 28.38270
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 19.99890 20.00600
SMT-RAT SMT-RAT-final default unsat ✅ 371.24200 371.33200
STP stp-cryptominisat4 default unsat ✅ 6.44577 6.44702
stp-cmsat4-v15 default unsat ✅ 8.16096 8.16176
stp-cmsat4-mt-v15 default unknown ❌ 1.62458 1.62375
stp-minisat-v15 default unsat ✅ 12.37050 12.37210
Yices2 Yices default unsat ✅ 6.82894 6.82996
Z3 z3 4.4.0 default unsat ✅ 2.13621 2.13667
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 164.16900 164.27800
ABC_glucose glucose unsat ✅ 20.64660 20.65820
Boolector Boolector boolector unsat ✅ 23.88890 23.90320
Boolector preprop boolector unsat ✅ 24.13100 24.14470
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 16.60570 32.66480
MapleSTP MapleSTP default unsat ✅ 25.41690 25.43360
MapleSTP-mt default unsat ✅ 34.19110 131.28000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 15.88110 15.89130
MinkeyRink Minkeyrink 2016 default unsat ✅ 4.55613 8.93837
Q3B Q3B default unknown ❌ 2400.07000 7203.76000
STP stp-cms-exp-2016 default unsat ✅ 6.47362 6.47732
stp-cms-mt-2016 default unsat ✅ 6.05330 19.36660
stp-cms-st-2016 default unsat ✅ 5.93236 5.93623
stp-minisat-st-2016 default unsat ✅ 32.46550 32.48080
Yices2 Yices-2.4.2 default unsat ✅ 7.20828 7.21264
Z3 z3-4.4.1 default unsat ✅ 1.99922 2.00153
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 8.41790 8.41717
Boolector SMT17 final boolector unsat ✅ 25.02040 25.01090
CVC4 CVC4-smtcomp2017-main default unsat ✅ 18.39840 35.94240
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 36.78460 36.74670
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 2.48907 2.49599
Q3B Q3B default unknown ❌ 600.06500 1787.78000
STP stp_st default unsat ✅ 10.98660 10.98620
stp_mt default unsat ✅ 54.07550 33.62700
Yices2 Yices2-Main default unsat ✅ 9.10422 9.10266
Z3 z3-4.5.0 default unsat ✅ 2.11246 2.11244
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 4.02719 4.02692
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 4.76304 4.76311
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 19.84740 19.84710
MinkeyRink Minkeyrink MT_mt unsat ✅ 4.06211 12.43530
Minkeyrink ST_st unsat ✅ 3.83222 3.83187
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 12.06230 12.05830
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 13.83490 42.90930
STP-Riss-st-2018_riss-no-stderr unsat ✅ 11.20610 11.20560
Yices2 Yices 2.6.0_default unsat ✅ 5.48711 5.48698
Z3 z3-4.7.1_default unsat ✅ 3.90624 3.90558
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 5.75146 5.75135
Poolector-wrapped-sq_default unsat ✅ 7.45185 36.63300
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 7.06044 7.05983
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.02242 5.02253
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 2.86698 7.83877
MinkeyRink ST-wrapped-sq_default unsat ✅ 3.34701 3.34689
Par4 Par4-wrapped-sq_default unsat ✅ 4.62329 13.79000
STP STP-2019-wrapped-sq_default unsat ✅ 12.02260 12.02240
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 26.28890 26.28600
stp-minisat-wrapped-sq_default unsat ✅ 16.08370 16.08370
stp-mt-wrapped-sq_default unsat ✅ 14.55740 44.64000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 28.36500 51.85280
stp-riss-wrapped-sq_default unknown ❌ 4.27025 4.27031
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 6.98221 6.98163
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 2.74339 2.74315
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 4.70050 4.70067
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 394.57600 394.46400
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 2.29556 2.29535
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.95816 1.95795
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 4.59148 4.49158
cvc5 cvc5 unsat ✅ 12.38716 12.28225
SMTInterpol SMTInterpol unknown ❌ 1201.74558 1275.32926
STP STP unsat ✅ 2.56015 2.45885
Yices2 Yices2 unsat ✅ 2.72865 2.62878
Z3alpha Z3-alpha unsat ✅ 53.08762 52.98681