Benchmark

non-incremental/QF_BV/asp/Sudoku/sudoku.in2.smt2 

Benchmark without description.
Benchmark
Size555739
Compressed Size64303
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 555731
Compressed Size64311
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants5657
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true93 not4835 or36 and1
=>6660 =8987 bvsub2960 bvuge370

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 2.83104 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 1.51566 —
abziz_portfolio_2011_solvers_2 default sat ✅ 1.51843 —
abziz_portfolio_2012_minfeatures default sat ✅ 1.51929 —
abziz_portfolio_2012_solvers default sat ✅ 1.52092 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 1.53429 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 5.98473 —
Boolector-SMT-COMP-2011 default sat ✅ 33.83640 —
Boolector-SMT-COMP-2012 default sat ✅ 4.36125 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 8.89445 —
CVC4-SMT-EVAL-2013 default sat ✅ 24.14790 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 7.04963 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 7.63284 —
MathSAT5-SMT-COMP-2011 default sat ✅ 7.92903 —
MathSAT5-SMT-COMP-2012 default sat ✅ 7.73296 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 2.90479 —
SONOLAR-SMT-COMP-2010 default sat ✅ 4.13552 —
SONOLAR-SMT-COMP-2011 default sat ✅ 32.99510 —
SONOLAR-SMT-COMP-2012 default sat ✅ 3.24959 —
STP STP2-SMT-COMP-2011 default sat ✅ 3.03761 —
STP2-SMT-COMP-2012 default sat ✅ 2.99326 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 4.21533 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 1.57219 —
Z3-SMT-COMP-2011 default sat ✅ 1.50624 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 9.15460 9.15561
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 7.24232 14.19080
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 8.46259 16.63850
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 10.24860 10.25140
SMT-RAT SMT-RAT-final default sat ✅ 283.26700 283.34600
STP stp-cryptominisat4 default sat ✅ 4.77483 4.77427
stp-cmsat4-v15 default sat ✅ 3.86205 3.86241
stp-cmsat4-mt-v15 default unknown ❌ 1.57915 1.57876
stp-minisat-v15 default sat ✅ 4.37146 4.37233
Yices2 Yices default sat ✅ 3.84493 3.84441
Z3 z3 4.4.0 default sat ✅ 1.79918 1.79972
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 29.06570 29.08250
ABC_glucose glucose sat ✅ 11.19800 11.20450
Boolector Boolector boolector sat ✅ 14.11340 14.12250
Boolector preprop boolector sat ✅ 14.12340 14.13180
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 8.93792 17.60510
MapleSTP MapleSTP default sat ✅ 4.35052 4.35389
MapleSTP-mt default sat ✅ 5.49241 16.86770
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 8.05791 8.06357
MinkeyRink Minkeyrink 2016 default sat ✅ 6.38160 11.69330
Q3B Q3B default unknown ❌ 2400.04000 7204.33000
STP stp-cms-exp-2016 default sat ✅ 5.42755 5.43106
stp-cms-mt-2016 default sat ✅ 4.51432 13.15110
stp-cms-st-2016 default sat ✅ 3.79142 3.79397
stp-minisat-st-2016 default sat ✅ 20.49220 20.50390
Yices2 Yices-2.4.2 default sat ✅ 3.63771 3.63973
Z3 z3-4.4.1 default sat ✅ 1.78577 1.78838
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 5.37709 5.37573
Boolector SMT17 final boolector sat ✅ 13.46460 13.45630
CVC4 CVC4-smtcomp2017-main default sat ✅ 9.99638 19.71760
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 9.04463 9.04431
MinkeyRink MinkeyRink 2017.3a default sat ✅ 3.35994 3.37413
Q3B Q3B default unknown ❌ 600.04200 1189.11000
STP stp_st default sat ✅ 4.99499 4.98294
stp_mt default sat ✅ 4.78457 13.30650
Yices2 Yices2-Main default sat ✅ 4.99278 4.99151
Z3 z3-4.5.0 default sat ✅ 1.79665 1.79672
SMT-COMP 2018 Boolector Boolector_default sat ✅ 2.59967 2.59940
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 5.01536 5.01533
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 8.35192 8.35303
MinkeyRink Minkeyrink MT_mt sat ✅ 2.90553 7.64714
Minkeyrink ST_st sat ✅ 2.31554 2.31576
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.36595 3.36625
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.99825 10.70000
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.93039 6.92941
Yices2 Yices 2.6.0_default sat ✅ 3.17824 3.17775
Z3 z3-4.7.1_default sat ✅ 4.62893 4.62899
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 2.76611 2.76580
Poolector-wrapped-sq_default sat ✅ 3.51194 13.51000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 5.55556 5.55519
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 5.20446 5.20414
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 2.61437 6.84127
MinkeyRink ST-wrapped-sq_default sat ✅ 2.10428 2.10394
Par4 Par4-wrapped-sq_default sat ✅ 3.31768 9.86000
STP STP-2019-wrapped-sq_default sat ✅ 3.23534 3.23579
stp-mergesat-fixed-wrapped-sq_default sat ✅ 6.78267 6.78261
stp-minisat-wrapped-sq_default sat ✅ 3.06621 3.06633
stp-mt-wrapped-sq_default sat ✅ 3.88023 10.09930
stp-portfolio-fixed-wrapped-sq_default sat ✅ 7.08602 11.27600
stp-riss-wrapped-sq_default unknown ❌ 1.71457 1.71480
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 3.60397 3.60407
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 2.55700 2.55645
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 5.89552 5.89518
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 28.11880 28.11760
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 4.52544 4.52528
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.88067 1.88036
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.79389 2.79390
MathSAT mathsat-5.6.6_default sat ✅ 15.31490 15.31410
STP STP 2021.0_default sat ✅ 2.92520 6.96952
Z3 z3-4.8.11_default sat ✅ 2.25018 2.24994
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default sat ✅ 2.84398 2.84386
Bitwuzla-wrapped_default sat ✅ 2.90011 2.89983
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 9.46422 9.46239
MathSAT MathSAT-5.6.8_default sat ✅ 15.72750 15.72800
STP STP 2022.4_default sat ✅ 3.50200 3.50160
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.83272 1.83234
Z3++BV z3++bv_0702_default sat ✅ 3.54391 3.54332
Z3 z3-4.8.17_default sat ✅ 2.34333 2.34524
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 3.71261 3.61093
cvc5 cvc5 sat ✅ 7.72222 7.62235
SMTInterpol SMTInterpol unknown ❌ 1201.77955 1275.35431
STP STP sat ✅ 2.62839 2.52742
Yices2 Yices2 sat ✅ 1.63742 1.53638
Z3alpha Z3-alpha sat ✅ 14.66569 14.55995
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 2.11478 1.98690
Bitwuzla-MachBV-base sat ✅ 3.08391 2.95849
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 1.84455 1.72308
BVDecide bv_decide sat ✅ 272.11061 271.90464
bv_decide-nokernel sat ✅ 100.01223 99.83686
cvc5 cvc5 sat ✅ 6.02087 5.89523
SMTInterpol SMTInterpol unknown ❌ 1201.34667 1234.03843
Yices2 Yices2 sat ✅ 1.38881 1.26878
Z3alpha Z3-alpha sat ✅ 2.42799 8.02020
Z3 Z3-alpha-base sat ✅ 1.58529 1.46347
Z3-Owl-base sat ✅ 5.46009 5.34041
z3siri-base sat ✅ 1.54924 1.41796
Z3-Owl Z3-Owl sat ✅ 10.28225 10.14999