Benchmark

non-incremental/QF_IDL/queens_bench/n_queen/queen60-1.smt2 

Queens benchmarks generated by Hyondeuk Kim in SMT-LIB format.
Benchmark
Size151638
Compressed Size22873
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2006-08-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 151630
Compressed Size22704
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants61
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not5310 and1 =5310 let1
-3600 <=60 >=60

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2006 0.50 (4/8) ARIO Ario 1.2 timeout ✅ 1208.30000 —
Barcelogic Barcelogic 1.1 sat ✅ 71.50000 —
Barcelogic 1.0 (2005 winner) timeout ✅ 1209.00000 —
CVC3 CVC3 unknown ❌ 324.00000 —
ExtSAT ExtSAT 1.1 timeout ✅ 1207.40000 —
HTP HTP timeout ✅ 1208.30000 —
HTP patched (hors-concours) timeout ✅ 1208.70000 —
MathSAT MathSAT 3.4 sat ✅ 5.20000 —
Sateen Sateen sat ✅ 289.30000 —
Yices Yices 1.0 sat ✅ 1.10000 —
SMT Evaluation 2013 0.40 (3/5) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 99.91170 —
CVC4-SMT-EVAL-2013 default sat ✅ 86.96630 —
OpenSMT OpenSMT-SMT-COMP-2010 default sat ✅ 46.90520 —
OpenSMT-SMT-COMP-2011 default sat ✅ 29.26550 —
veriT veriT-SMT-COMP-2010 default unknown ❌ — —
veriT-SMT-COMP-2011 default unknown ❌ — —
veriT-SMT-EVAL-2013 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.33046 —
Z3-SMT-COMP-2011 default sat ✅ 0.37962 —
SMT-COMP 2014 CVC4 CVC4 f7118b2 default sat ✅ 56.24820 56.26040
veriT veriT-smtcomp2014 default sat ✅ 576.64200 576.86900
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.17397 0.16497
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.24491 0.24396
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 83.25340 83.27330
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 89.51960 89.55540
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 8.49750 16.60050
veriT veriT default sat ✅ 685.61100 685.82600
Yices2 Yices default sat ✅ 0.13217 0.13098
Z3 z3 4.4.0 default sat ✅ 0.49604 0.49592
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 96.65010 96.71270
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 9.62613 20.67670
veriT veriT-dev default sat ✅ 458.63200 458.92300
Yices2 Yices-2.4.2 default sat ✅ 0.18432 0.18441
Z3 z3-4.4.1 default sat ✅ 0.56204 0.56166
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default sat ✅ 55.88920 55.88670
SMTInterpol SMTInterpol default sat ✅ 17.19960 26.56260
veriT veriT-2017-06-17 default sat ✅ 491.78800 491.72600
Yices2 Yices2-Main default sat ✅ 0.14852 0.14783
Z3 z3-4.5.0 default sat ✅ 0.37894 0.37780
SMT-COMP 2018 0.14 (6/7) CVC4 CVC4-experimental-idl-2_default sat ✅ 2.02055 2.02052
master-2018-06-10-b19c840-competition-default_default sat ✅ 59.63250 59.62460
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1086.21000 1086.10000
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 11.67140 19.09180
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1200.03000
veriT veriT_default sat ✅ 725.22200 725.14300
Yices2 Yices 2.6.0_default sat ✅ 0.41103 0.41095
Z3 z3-4.7.1_default sat ✅ 0.45210 0.45183
SMT-COMP 2020 CVC4 CVC4-sq-final_default sat ✅ 69.91020 69.90860
MathSAT MathSAT5_default.sh sat ✅ 462.90500 462.84700
Par4 Par4-wrapped-sq_default sat ✅ 0.47020 0.00643
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 157.08500 173.83800
veriT veriT_default sat ✅ 191.66000 191.63000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.60203 0.60191
Z3 z3-4.8.8_default sat ✅ 0.59171 0.59167
z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.55904 0.55900
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 43.17890 43.18020
MathSAT MathSAT-5.6.8_default sat ✅ 928.33000 928.10300
Par4 Par4-wrapped-sq_default sat ✅ 0.31147 0.00703
veriT veriT_default sat ✅ 202.53000 202.51200
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.29170 0.29165
Z3 z3-4.8.17_default sat ✅ 0.50845 0.51026
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 29.75670 29.74810
OpenSMT OpenSMT a78dcf01_default sat ✅ 111.49400 111.47900
Par4 Par4-wrapped-sq_default sat ✅ 0.18752 0.00645
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 510.58200 529.68100
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.15810 0.15809
Z3++ Z3++_sq_0526_default sat ✅ 0.37173 0.37178
SMT-COMP 2024 cvc5 cvc5 sat ✅ 35.35998 35.24470
OpenSMT OpenSMT sat ✅ 54.18897 54.07256
SMTInterpol SMTInterpol sat ✅ 713.03567 752.99038
Yices2 Yices2 sat ✅ 0.37904 0.27905
Z3alpha Z3-alpha sat ✅ 0.52321 0.42360