Benchmark

non-incremental/QF_BV/asp/Solitaire/solitaire-asymmetric-time=30.smt2 

Benchmark without description.
Benchmark
Size2133050
Compressed Size241650
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2133042
Compressed Size241662
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants26462
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true208 not15300 or2491 and7595
=>9120 =31021 bvsub4500 bvuge60

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 0.71 (2/7) 4Simp 4Simp unknown ❌ 1200.00000 —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unknown ❌ 1200.00000 —
Boolector Boolector sat ✅ 913.90000 —
CVC3 CVC3 v2.4.2 unknown ❌ — —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
MathSAT MathSAT-HeavyBV unknown ❌ 1200.10000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 sat ✅ 443.20000 —
SMT Evaluation 2013 1.00 (0/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 346.89600 346.97700
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.29000 4818.85000
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 557.00200 1117.09000
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1597.43000 1597.88000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.92000
STP stp-cryptominisat4 default sat ✅ 559.09400 559.23300
stp-cmsat4-v15 default sat ✅ 755.53300 755.73600
stp-cmsat4-mt-v15 default unknown ❌ 4.68355 4.68429
stp-minisat-v15 default unknown ❌ 2400.01000 2400.73000
Yices2 Yices default sat ✅ 502.77300 502.93100
Z3 z3 4.4.0 default sat ✅ 424.77400 424.94700
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unknown ❌ 60.13900 57.34560
ABC_glucose glucose sat ✅ 202.02500 202.11900
Boolector Boolector boolector sat ✅ 534.26800 534.55200
Boolector preprop boolector sat ✅ 528.83800 529.12700
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 1187.21000 2383.78000
MapleSTP MapleSTP default unknown ❌ 2400.01000 2401.38000
MapleSTP-mt default unknown ❌ 2400.06000 9517.11000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2044.08000 2045.25000
MinkeyRink Minkeyrink 2016 default sat ✅ 29.89760 76.70890
Q3B Q3B default unknown ❌ 2400.04000 7203.76000
STP stp-cms-exp-2016 default sat ✅ 627.91800 628.20600
stp-cms-mt-2016 default sat ✅ 159.68300 619.71900
stp-cms-st-2016 default sat ✅ 602.13500 602.42200
stp-minisat-st-2016 default unknown ❌ 2400.02000 2401.33000
Yices2 Yices-2.4.2 default sat ✅ 273.87000 274.00500
Z3 z3-4.4.1 default sat ✅ 166.66600 166.72400
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 460.74800 460.63800
Boolector SMT17 final boolector sat ✅ 582.49400 582.42400
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.11200 1205.36000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.05000 599.95000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 111.20900 215.84000
Q3B Q3B default unknown ❌ 600.07300 1794.87000
STP stp_st default unknown ❌ 600.03100 599.92400
stp_mt default unknown ❌ 600.07700 1572.03000
Yices2 Yices2-Main default sat ✅ 529.03600 529.01700
Z3 z3-4.5.0 default sat ✅ 193.36800 193.37400
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 53.49800 53.49770
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 37.43240 37.43190
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1199.69000
MinkeyRink Minkeyrink MT_mt sat ✅ 57.86430 216.21500
Minkeyrink ST_st sat ✅ 87.30400 87.26390
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.02000 1199.88000
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 698.85900 2760.76000
STP-Riss-st-2018_riss-no-stderr sat ✅ 620.84300 620.81700
Yices2 Yices 2.6.0_default sat ✅ 625.91800 625.89800
Z3 z3-4.7.1_default sat ✅ 742.65700 742.62800
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 16.68540 16.68550
Boolector Boolector-wrapped-sq_default sat ✅ 221.38400 221.32700
Poolector-wrapped-sq_default sat ✅ 133.95900 530.44000
CVC4 CVC4-sq-final_default sat ✅ 193.69400 193.64800
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.64000
MathSAT MathSAT5_default.sh unknown ❌ 1200.03000 1199.84000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 4.43929 4.43946
MinkeyRink Solver 2020.3_default sat ✅ 60.93250 228.36400
STP STP_default sat ✅ 134.21700 510.90200
STP ++ Mergsat v1_default sat ✅ 560.26400 560.16000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 40.74280 40.73900
Z3 z3-4.8.8_default sat ✅ 130.70200 130.69300
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 125.26700 125.25900
MathSAT mathsat-5.6.6_default unknown ❌ 1200.07000 1199.77000
STP STP 2021.0_default sat ✅ 222.55600 869.13900
Z3 z3-4.8.11_default sat ✅ 891.52800 891.42000
SMT-COMP 2022 0.14 (6/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 133.37800 133.31000
Bitwuzla-wrapped_default sat ✅ 77.03530 76.98550
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 625.83500 625.64600
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.03000 1199.86000
STP STP 2022.4_default sat ✅ 17.72240 17.72020
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 84.18110 84.17540
Z3++BV z3++bv_0702_default sat ✅ 62.72220 62.71440
Z3 z3-4.8.17_default sat ✅ 340.81700 340.72400
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 163.63900 163.62100
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 287.45700 287.40400
STP STP 2022.4_default sat ✅ 171.52000 171.49100
STP 2022.4_default sat ✅ 171.77300 171.76600
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1220.89000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 354.28900 354.24300
Z3-Owl z3-Owl-Final_default sat ✅ 195.46600 195.38200
z3-Owl-Final_default sat ✅ 182.45800 182.44500
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 38.32355 38.19641
Bitwuzla-MachBV-base sat ✅ 39.04499 38.92857
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 33.39462 33.25209
BVDecide bv_decide unknown ❌ 1201.38802 1201.08842
bv_decide-nokernel sat ✅ 1074.95794 1074.67065
cvc5 cvc5 sat ✅ 460.75757 460.57967
SMTInterpol SMTInterpol unknown ❌ 1201.47560 1251.36245
Yices2 Yices2 sat ✅ 59.83468 59.70218
Z3alpha Z3-alpha sat ✅ 498.66776 1990.64561
Z3 Z3-alpha-base sat ✅ 547.93010 547.70508
Z3-Owl-base unknown ❌ 1201.29081 1201.02671
z3siri-base sat ✅ 553.29604 553.09361
Z3-Owl Z3-Owl sat ✅ 1054.41628 1054.15322