Benchmark

non-incremental/QF_BV/asp/Sudoku/sudoku.in3.smt2 

Benchmark without description.
Benchmark
Size11621084
Compressed Size1179330
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 11621076
Compressed Size1179334
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants106851
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true793 not100433 or369 and1
=>137850 =175776 bvsub66168 bvuge2757

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 1.00 (0/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unknown ❌ — —
AbzizPortfolio-SMT-COMP-2012 default unknown ❌ — —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unknown ❌ — —
Boolector-SMT-COMP-2011 default unknown ❌ — —
Boolector-SMT-COMP-2012 default unknown ❌ — —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unknown ❌ — —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unknown ❌ — —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unknown ❌ — —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unknown ❌ — —
STP2-SMT-COMP-2012 default unknown ❌ — —
simplifyingSTP-SMT-COMP-2010 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2015 0.71 (2/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 2249.62000 2250.51000
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.35000 4809.28000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.26000 4809.74000
MathSAT MathSat 5.3.6 main smtcomp2015_main unknown ❌ 2400.01000 2400.69000
SMT-RAT SMT-RAT-final default unknown ❌ 1354.82000 1355.47000
STP stp-cryptominisat4 default unknown ❌ 2400.01000 2400.70000
stp-cmsat4-v15 default unknown ❌ 2400.01000 2400.41000
stp-cmsat4-mt-v15 default unknown ❌ 50.28590 50.30540
stp-minisat-v15 default unknown ❌ 2400.01000 2400.46000
Yices2 Yices default unknown ❌ 2400.01000 2400.83000
Z3 z3 4.4.0 default sat ✅ 1095.69000 1096.05000
SMT-COMP 2016 0.50 (5/10) ABC ABC_default default_abc unknown ❌ 553.73800 515.14600
ABC_glucose glucose sat ✅ 1612.81000 1613.67000
Boolector Boolector boolector unknown ❌ 2400.04000 2401.42000
Boolector preprop boolector unknown ❌ 2400.03000 2401.35000
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.39000 4813.90000
MapleSTP MapleSTP default unknown ❌ 2400.11000 2401.22000
MapleSTP-mt default sat ✅ 2382.63000 9300.97000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unknown ❌ 2400.05000 2401.20000
MinkeyRink Minkeyrink 2016 default sat ✅ 628.10900 2062.67000
Q3B Q3B default unknown ❌ 2400.08000 7202.52000
STP stp-cms-exp-2016 default sat ✅ 1298.72000 1299.22000
stp-cms-mt-2016 default sat ✅ 883.05800 3309.42000
stp-cms-st-2016 default sat ✅ 1268.90000 1269.72000
stp-minisat-st-2016 default unknown ❌ 2400.03000 2401.23000
Yices2 Yices-2.4.2 default unknown ❌ 2400.03000 2401.44000
Z3 z3-4.4.1 default sat ✅ 1030.90000 1031.29000
SMT-COMP 2017 0.88 (1/8) Boolector Boolector+CaDiCaL SMT17 final boolector unknown ❌ 600.02300 599.87000
Boolector SMT17 final boolector unknown ❌ 600.07700 599.97000
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.42900 1197.30000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.05400 599.87000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 423.36500 812.43000
Q3B Q3B default unknown ❌ 600.06200 1752.70000
STP stp_st default unknown ❌ 600.02300 599.77000
stp_mt default unknown ❌ 600.06700 1760.90000
Yices2 Yices2-Main default unknown ❌ 600.01600 599.87000
Z3 z3-4.5.0 default unknown ❌ 600.05000 599.85000
SMT-COMP 2018 0.43 (4/7) Boolector Boolector_default sat ✅ 250.47100 250.45600
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 487.77300 487.74900
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.03000 1199.85000
MinkeyRink Minkeyrink MT_mt sat ✅ 423.14800 1546.53000
Minkeyrink ST_st sat ✅ 449.07500 448.93300
STP STP-CMS-st-2018_default-no-stderr sat ✅ 889.78500 888.91600
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 760.20900 2857.67000
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.02000 1199.86000
Yices2 Yices 2.6.0_default unknown ❌ 1200.01000 1199.86000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.86000
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default sat ✅ 296.30900 296.24900
Bitwuzla-wrapped_default sat ✅ 328.57600 328.55600
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 1199.81000
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.04000 1199.68000
STP STP 2022.4_default sat ✅ 424.07800 423.85300
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 328.58500 328.54200
Z3++BV z3++bv_0702_default sat ✅ 357.33000 357.22400
Z3 z3-4.8.17_default sat ✅ 243.25600 243.22600
SMT-COMP 2023 0.50 (3/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 416.69000 416.50400
cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.04000 1199.67000
STP STP 2022.4_default sat ✅ 424.75000 424.62400
STP 2022.4_default sat ✅ 428.37800 428.32900
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.15000 1230.50000
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.12000 1199.74000
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.03000 1200.07000
z3-Owl-Final_default sat ✅ 836.88200 836.38600
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 367.38854 367.19548
cvc5 cvc5 unknown ❌ 1201.71521 1201.00020
SMTInterpol SMTInterpol unknown ❌ 1202.21742 1299.86167
STP STP sat ✅ 350.81100 350.54244
Yices2 Yices2 sat ✅ 352.97774 352.84376
Z3alpha Z3-alpha sat ✅ 397.87533 397.70390
SMT-COMP 2025 0.44 (5/9) Bitwuzla Bitwuzla sat ✅ 198.48784 198.33290
Bitwuzla-MachBV-base sat ✅ 276.14601 275.99173
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 214.17386 214.00207
BVDecide bv_decide unknown ❌ 1201.38846 1201.08137
bv_decide-nokernel unknown ❌ 1201.39060 1201.07551
cvc5 cvc5 unknown ❌ 1201.79162 1201.37156
SMTInterpol SMTInterpol unknown ❌ 1201.88685 1967.39645
Yices2 Yices2 sat ✅ 428.13380 427.95898
Z3alpha Z3-alpha sat ✅ 256.13822 998.16686
Z3 Z3-alpha-base sat ✅ 139.89488 139.76553
Z3-Owl-base sat ✅ 404.10657 403.94448
z3siri-base sat ✅ 147.57703 147.40982
Z3-Owl Z3-Owl unknown ❌ 1201.76621 1201.34312