Benchmark

non-incremental/QF_BV/asp/Sokoban/duthen-990602.29.steps.11.asp.smt2

Benchmark without description.
Benchmark
Size1055929
Compressed Size125329
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1055921
Compressed Size125318
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants13346
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true208 not7542 or1774 and6135
=>3771 =14705 bvsub1712 bvugt458
bvuge24

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 6.58679
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 4.11746
abziz_portfolio_2011_solvers_2 default unsat ✅ 4.10948
abziz_portfolio_2012_minfeatures default unsat ✅ 4.40930
abziz_portfolio_2012_solvers default unsat ✅ 4.42979
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 4.06826
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 14.76910
Boolector-SMT-COMP-2011 default unsat ✅ 22.42910
Boolector-SMT-COMP-2012 default unsat ✅ 17.66440
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 892.03600
CVC3-SMT-COMP-2011 default unsat ✅ 840.56700
CVC3-SMT-COMP-2012 default unsat ✅ 829.42100
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 197.37900
CVC4-SMT-EVAL-2013 default unsat ✅ 82.30420
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 73.40340
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 16.21640
MathSAT5-SMT-COMP-2011 default unsat ✅ 82.84070
MathSAT5-SMT-COMP-2012 default unsat ✅ 64.33830
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 9.58475
SONOLAR-SMT-COMP-2010 default unknown ❌ 31.47090
SONOLAR-SMT-COMP-2011 default unknown ❌
SONOLAR-SMT-COMP-2012 default unsat ✅ 7.65287
STP STP2-SMT-COMP-2011 default unsat ✅ 9.41400
STP2-SMT-COMP-2012 default unsat ✅ 6.49633
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 19.48730
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 5.46260
Z3-SMT-COMP-2011 default unsat ✅ 4.72440
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 16.70510 16.70450
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 20.53330 40.62580
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 17.00340 33.53590
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 23.01460 23.02250
SMT-RAT SMT-RAT-final default unsat ✅ 805.10800 805.25000
STP stp-cryptominisat4 default unsat ✅ 12.24510 12.24710
stp-cmsat4-v15 default unsat ✅ 13.13750 13.13900
stp-cmsat4-mt-v15 default unknown ❌ 1.23236 1.22981
stp-minisat-v15 default unsat ✅ 9.83541 9.83650
Yices2 Yices default unsat ✅ 13.54210 13.54690
Z3 z3 4.4.0 default unsat ✅ 6.04986 6.05208
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 363.61800 363.80900
ABC_glucose glucose unsat ✅ 19.73280 19.74550
Boolector Boolector boolector unsat ✅ 22.84230 22.85480
Boolector preprop boolector unsat ✅ 22.97680 22.98950
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 18.53950 36.63560
MapleSTP MapleSTP default unsat ✅ 41.25700 41.28430
MapleSTP-mt default unsat ✅ 42.20410 164.20400
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 29.07200 29.08890
MinkeyRink Minkeyrink 2016 default unsat ✅ 7.57295 22.70950
Q3B Q3B default unknown ❌ 2400.03000 7203.15000
STP stp-cms-exp-2016 default unsat ✅ 11.00960 11.01590
stp-cms-mt-2016 default unsat ✅ 11.46230 41.89670
stp-cms-st-2016 default unsat ✅ 9.84594 9.85235
stp-minisat-st-2016 default unsat ✅ 68.76590 68.80610
Yices2 Yices-2.4.2 default unsat ✅ 13.23970 13.24840
Z3 z3-4.4.1 default unsat ✅ 5.74979 5.75438
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 10.37140 10.36780
Boolector SMT17 final boolector unsat ✅ 25.64700 25.63600
CVC4 CVC4-smtcomp2017-main default unsat ✅ 21.38610 42.33770
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 36.77660 36.77320
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 5.14904 5.23872
Q3B Q3B default unknown ❌ 600.07300 1026.64000
STP stp_st default unsat ✅ 30.76680 30.16940
stp_mt default unsat ✅ 23.03980 63.79550
Yices2 Yices2-Main default unsat ✅ 11.64240 11.63920
Z3 z3-4.5.0 default unsat ✅ 6.03625 6.03632
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 4.98845 4.98794
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.19092 5.19073
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 24.10750 24.11000
MinkeyRink Minkeyrink MT_mt unsat ✅ 5.89409 20.40300
Minkeyrink ST_st unsat ✅ 5.20233 5.20234
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 16.63360 16.63130
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 21.85590 77.95560
STP-Riss-st-2018_riss-no-stderr unsat ✅ 11.38340 11.38270
Yices2 Yices 2.6.0_default unsat ✅ 10.47880 10.47890
Z3 z3-4.7.1_default unsat ✅ 11.04030 11.04030
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 4.91814 4.91748
Boolector Boolector-wrapped-sq_default unsat ✅ 5.90555 5.90531
Poolector-wrapped-sq_default unsat ✅ 8.32591 32.41980
CVC4 CVC4-sq-final_default unsat ✅ 5.74479 5.74477
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.09000 1200.02000
MathSAT MathSAT5_default.sh unsat ✅ 115.85900 115.85300
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.94629 0.94653
MinkeyRink Solver 2020.3_default unsat ✅ 5.62439 19.30710
STP STP_default unsat ✅ 22.11200 78.29110
STP ++ Mergsat v1_default unsat ✅ 32.59690 32.60020
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 1.82118 1.82110
Z3 z3-4.8.8_default unsat ✅ 4.99005 4.98978
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 4.65121 4.54942
cvc5 cvc5 unsat ✅ 10.72170 10.61699
SMTInterpol SMTInterpol unknown ❌ 1201.74579 1313.75504
STP STP unsat ✅ 3.04824 2.94874
Yices2 Yices2 unsat ✅ 3.06160 2.96142
Z3alpha Z3-alpha unsat ✅ 135.88292 135.78023