Benchmark

non-incremental/QF_BV/asp/15Puzzle/15-puzzle.init5.smt2 

Benchmark without description.
Benchmark
Size4224785
Compressed Size554525
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 4224777
Compressed Size554535
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants48208
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true153 not21598 or8436 and34807
=>5504 =50720 bvsub2138 bvuge614

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 1.00 (0/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 40.06320 40.07090
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 150.43600 299.69000
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 102.53100 203.43400
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 102.98800 103.02800
SMT-RAT SMT-RAT-final default sat ✅ 577.03700 577.08700
STP stp-cryptominisat4 default sat ✅ 583.70000 583.90000
stp-cmsat4-v15 default sat ✅ 638.80500 639.04200
stp-cmsat4-mt-v15 default unknown ❌ 363.06100 363.19100
stp-minisat-v15 default sat ✅ 565.17800 565.30900
Yices2 Yices default sat ✅ 48.48870 48.50760
Z3 z3 4.4.0 default sat ✅ 28.57180 28.58370
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unknown ❌ 91.99570 88.05380
ABC_glucose glucose sat ✅ 67.73640 67.77370
Boolector Boolector boolector sat ✅ 42.15000 42.17480
Boolector preprop boolector sat ✅ 44.45090 44.47720
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 147.46600 293.76900
MapleSTP MapleSTP default sat ✅ 771.20000 771.58600
MapleSTP-mt default sat ✅ 751.59400 1371.61000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 82.37250 82.39160
MinkeyRink Minkeyrink 2016 default sat ✅ 40.01340 109.02300
Q3B Q3B default unknown ❌ 2400.07000 7203.14000
STP stp-cms-exp-2016 default sat ✅ 581.23000 581.52800
stp-cms-mt-2016 default sat ✅ 526.59800 548.27700
stp-cms-st-2016 default sat ✅ 572.86800 573.15400
stp-minisat-st-2016 default sat ✅ 1015.85000 1016.40000
Yices2 Yices-2.4.2 default sat ✅ 143.03600 143.09700
Z3 z3-4.4.1 default sat ✅ 20.88930 41.73520
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 61.32800 61.32890
Boolector SMT17 final boolector sat ✅ 73.15190 73.14630
CVC4 CVC4-smtcomp2017-main default sat ✅ 139.09100 276.65200
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 106.73200 106.72200
MinkeyRink MinkeyRink 2017.3a default sat ✅ 30.31710 44.31000
Q3B Q3B default unknown ❌ 600.05900 1786.24000
STP stp_st default unknown ❌ 600.03600 599.99100
stp_mt default unknown ❌ 600.04500 599.95000
Yices2 Yices2-Main default sat ✅ 85.90240 85.88320
Z3 z3-4.5.0 default sat ✅ 44.05070 44.04140
SMT-COMP 2018 Boolector Boolector_default sat ✅ 50.84220 50.84200
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 48.11830 48.11860
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 312.56400 312.51500
MinkeyRink Minkeyrink MT_mt sat ✅ 58.02660 193.98300
Minkeyrink ST_st sat ✅ 57.28540 57.27960
STP STP-CMS-st-2018_default-no-stderr sat ✅ 608.80800 608.76200
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 611.08300 776.48500
STP-Riss-st-2018_riss-no-stderr sat ✅ 570.38600 570.34500
Yices2 Yices 2.6.0_default sat ✅ 13.99200 13.99150
Z3 z3-4.7.1_default sat ✅ 57.87470 57.86930
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 30.24390 30.24280
MathSAT mathsat-5.6.6_default sat ✅ 156.02600 155.94200
STP STP 2021.0_default sat ✅ 213.56800 588.96500
Z3 z3-4.8.11_default sat ✅ 21.01270 21.00970
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 27.76280 27.76080
Bitwuzla-wrapped_default sat ✅ 30.87930 30.87750
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 1199.45000
MathSAT MathSAT-5.6.8_default sat ✅ 337.18600 337.14900
STP STP 2022.4_default sat ✅ 20.26190 20.26050
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 12.27280 12.27140
Z3++BV z3++bv_0702_default sat ✅ 20.07070 20.07020
Z3 z3-4.8.17_default sat ✅ 63.64790 63.64960
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 84.83581 84.70394
cvc5 cvc5 unknown ❌ 1202.74282 1201.50905
SMTInterpol SMTInterpol unknown ❌ 1201.74461 1532.80141
STP STP sat ✅ 16.29946 16.19933
Yices2 Yices2 sat ✅ 14.06880 13.95267
Z3alpha Z3-alpha sat ✅ 241.89330 241.73662