Benchmark

non-incremental/QF_BV/asp/Sokoban/duthen-990602.52.steps.15.asp.smt2 

Benchmark without description.
Benchmark
Size1539486
Compressed Size182572
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1539478
Compressed Size182578
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants19325
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true227 not11077 or2664 and8906
=>5391 =21251 bvsub2440 bvugt706
bvuge32

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 19.18370 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 17.89850 —
abziz_portfolio_2011_solvers_2 default sat ✅ 538.32400 —
abziz_portfolio_2012_minfeatures default sat ✅ — —
abziz_portfolio_2012_solvers default sat ✅ 18.12600 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 18.03430 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 28.88400 —
Boolector-SMT-COMP-2011 default sat ✅ 34.39630 —
Boolector-SMT-COMP-2012 default sat ✅ 28.90080 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default sat ✅ 93.23200 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 227.16900 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 107.81600 —
MathSAT5-SMT-COMP-2011 default sat ✅ 533.17800 —
MathSAT5-SMT-COMP-2012 default sat ✅ 119.69900 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 33.29380 —
SONOLAR-SMT-COMP-2010 default sat ✅ 82.20790 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default sat ✅ 15.29030 —
STP STP2-SMT-COMP-2011 default sat ✅ 19.72440 —
STP2-SMT-COMP-2012 default sat ✅ 13.38570 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 54.28410 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 9.11290 —
Z3-SMT-COMP-2011 default sat ✅ 10.22610 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 29.43870 29.44350
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 60.29680 120.17000
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 28.08220 55.50460
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 54.50270 54.52870
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.91000
STP stp-cryptominisat4 default sat ✅ 46.62890 46.63390
stp-cmsat4-v15 default sat ✅ 42.87670 42.88950
stp-cmsat4-mt-v15 default unknown ❌ 2.18148 2.18067
stp-minisat-v15 default sat ✅ 37.22000 37.22130
Yices2 Yices default sat ✅ 43.99480 44.00130
Z3 z3 4.4.0 default sat ✅ 11.67840 11.68320
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 771.37300 771.78000
ABC_glucose glucose sat ✅ 29.38870 29.40430
Boolector Boolector boolector sat ✅ 46.44240 46.47320
Boolector preprop boolector sat ✅ 47.01590 47.04230
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 43.51440 86.51040
MapleSTP MapleSTP default sat ✅ 180.18800 180.28600
MapleSTP-mt default sat ✅ 123.25900 481.69300
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 51.34000 51.37120
MinkeyRink Minkeyrink 2016 default sat ✅ 15.97140 51.43150
Q3B Q3B default unknown ❌ 2400.09000 7204.11000
STP stp-cms-exp-2016 default sat ✅ 106.33500 106.39700
stp-cms-mt-2016 default sat ✅ 39.49490 148.86900
stp-cms-st-2016 default sat ✅ 41.90060 41.91950
stp-minisat-st-2016 default sat ✅ 110.43500 110.49800
Yices2 Yices-2.4.2 default sat ✅ 28.44360 28.45980
Z3 z3-4.4.1 default sat ✅ 12.75680 12.76530
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 16.55620 16.55480
Boolector SMT17 final boolector sat ✅ 50.04100 50.02820
CVC4 CVC4-smtcomp2017-main default sat ✅ 45.53690 90.56800
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 39.51040 39.50200
MinkeyRink MinkeyRink 2017.3a default sat ✅ 39.32940 27.49060
Q3B Q3B default unknown ❌ 600.04100 1784.68000
STP stp_st default sat ✅ 38.88820 38.87890
stp_mt default sat ✅ 39.68940 111.47500
Yices2 Yices2-Main default sat ✅ 25.29440 25.29360
Z3 z3-4.5.0 default sat ✅ 9.78401 9.78290
SMT-COMP 2018 Boolector Boolector_default sat ✅ 8.18866 8.18817
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 9.29488 9.29504
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 66.55200 66.55060
MinkeyRink Minkeyrink MT_mt sat ✅ 12.67210 45.43540
Minkeyrink ST_st sat ✅ 10.30170 10.30180
STP STP-CMS-st-2018_default-no-stderr sat ✅ 63.82270 63.81810
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 64.16600 239.86500
STP-Riss-st-2018_riss-no-stderr sat ✅ 23.42640 23.42330
Yices2 Yices 2.6.0_default sat ✅ 28.18280 28.17570
Z3 z3-4.7.1_default sat ✅ 17.44300 17.44320
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 7.08703 7.08575
MathSAT mathsat-5.6.6_default sat ✅ 310.40900 310.27600
STP STP 2021.0_default sat ✅ 59.53610 214.94300
Z3 z3-4.8.11_default sat ✅ 7.85725 7.85129
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 11.04710 11.04510
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 20.75290 20.75140
STP STP 2022.4_default sat ✅ 6.29016 6.28979
STP 2022.4_default sat ✅ 6.28836 6.28858
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1223.29000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 35.52910 35.53220
Z3-Owl z3-Owl-Final_default sat ✅ 30.55440 30.55320
z3-Owl-Final_default sat ✅ 18.91230 18.91100