Benchmark

non-incremental/QF_BV/asp/Sokoban/duthen-990602.57.steps.12.asp.smt2 

Benchmark without description.
Benchmark
Size1202168
Compressed Size140563
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1202160
Compressed Size140570
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants15122
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true222 not8643 or2043 and6880
=>4323 =16704 bvsub1962 bvugt518
bvuge26

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 14.42310 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 3.77963 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 3.57105 —
abziz_portfolio_2012_minfeatures default unsat ✅ 3.75883 —
abziz_portfolio_2012_solvers default unsat ✅ 3.64488 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 3.72839 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 15.13080 —
Boolector-SMT-COMP-2011 default unsat ✅ 24.23850 —
Boolector-SMT-COMP-2012 default unsat ✅ 20.59370 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unsat ✅ 87.00240 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 189.27400 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 70.53290 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 238.44000 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 213.76900 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 20.45410 —
SONOLAR-SMT-COMP-2010 default unknown ❌ 39.33840 —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unsat ✅ 21.62870 —
STP STP2-SMT-COMP-2011 default unsat ✅ 19.00520 —
STP2-SMT-COMP-2012 default unsat ✅ 11.41130 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 33.33000 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 3.96014 —
Z3-SMT-COMP-2011 default unsat ✅ 3.60178 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 16.59680 16.60250
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 29.35790 58.25910
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 30.55210 60.64380
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 37.13860 37.15640
SMT-RAT SMT-RAT-final default unsat ✅ 1855.53000 1856.01000
STP stp-cryptominisat4 default unsat ✅ 24.91490 24.91920
stp-cmsat4-v15 default unsat ✅ 24.17280 24.17630
stp-cmsat4-mt-v15 default unknown ❌ 1.70887 1.70874
stp-minisat-v15 default unsat ✅ 24.20130 24.20830
Yices2 Yices default unsat ✅ 20.38830 20.39490
Z3 z3 4.4.0 default unsat ✅ 4.22235 4.22436
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 388.77600 388.91000
ABC_glucose glucose unsat ✅ 23.91510 23.67170
Boolector Boolector boolector unsat ✅ 23.81820 23.82340
Boolector preprop boolector unsat ✅ 24.18810 24.20040
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 25.14060 49.83860
MapleSTP MapleSTP default unsat ✅ 319.15900 319.32700
MapleSTP-mt default unsat ✅ 244.97300 967.20200
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 45.80220 45.82960
MinkeyRink Minkeyrink 2016 default unsat ✅ 10.10530 31.63200
Q3B Q3B default unknown ❌ 2400.04000 7203.86000
STP stp-cms-exp-2016 default unsat ✅ 38.58200 38.60390
stp-cms-mt-2016 default unsat ✅ 24.05210 91.18170
stp-cms-st-2016 default unsat ✅ 27.85110 27.86540
stp-minisat-st-2016 default unsat ✅ 127.43000 127.49100
Yices2 Yices-2.4.2 default unsat ✅ 14.61550 14.62400
Z3 z3-4.4.1 default unsat ✅ 4.56991 4.57422
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 10.95760 10.95570
Boolector SMT17 final boolector unsat ✅ 24.97060 24.97030
CVC4 CVC4-smtcomp2017-main default unsat ✅ 35.94540 70.45690
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 56.50830 56.49030
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 5.63709 5.70649
Q3B Q3B default unknown ❌ 600.04300 1799.41000
STP stp_st default unsat ✅ 26.20010 26.19760
stp_mt default unsat ✅ 30.31460 61.58410
Yices2 Yices2-Main default unsat ✅ 35.40050 27.74900
Z3 z3-4.5.0 default unsat ✅ 4.83806 4.83731
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 5.88825 5.88788
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.96487 5.96458
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 34.48460 34.48290
MinkeyRink Minkeyrink MT_mt unsat ✅ 6.79267 23.53610
Minkeyrink ST_st unsat ✅ 6.38602 6.38068
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 19.82370 19.82050
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 24.52640 88.01990
STP-Riss-st-2018_riss-no-stderr unsat ✅ 15.87250 15.87300
Yices2 Yices 2.6.0_default unsat ✅ 19.54860 19.54600
Z3 z3-4.7.1_default unsat ✅ 12.49080 12.48900
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 6.03931 6.03939
Poolector-wrapped-sq_default unsat ✅ 8.46999 33.25000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 8.76291 8.76212
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.34425 5.34410
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 6.85896 23.91670
MinkeyRink ST-wrapped-sq_default unsat ✅ 5.54193 5.54182
Par4 Par4-wrapped-sq_default unsat ✅ 6.67920 19.79000
STP STP-2019-wrapped-sq_default unsat ✅ 18.77100 18.76050
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 37.91740 37.90570
stp-minisat-wrapped-sq_default unsat ✅ 17.58150 17.58030
stp-mt-wrapped-sq_default unsat ✅ 23.82670 85.31550
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 40.30820 80.45170
stp-riss-wrapped-sq_default unknown ❌ 3.08036 3.07981
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 15.48060 15.47930
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 5.18035 5.17966
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 8.80951 8.80934
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.92000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 6.84460 6.84434
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 6.73899 6.73866