Benchmark

non-incremental/QF_IDL/queens_bench/n_queen/queen69-1.smt2

Queens benchmarks generated by Hyondeuk Kim in SMT-LIB format.
Benchmark
Size201534
Compressed Size28529
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2006-08-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 201526
Compressed Size28776
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants70
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not7038 and1 =7038 let1
-4761 <=69 >=69

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 0.38 (5/8) Barcelogic Barcelogic 1.3 sat ✅ 8.90000
clsat clsat 0.17f unknown ❌ 1800.80000
CVC3 CVC3-1.5 unknown ❌ 1801.00000
MathSAT MathSAT-4.2 sat ✅ 2.90000
Sateen sateen-2.1.1 sat ✅ 5.60000
Yices2 Yices2 (proto c) sat ✅ 0.70000
Z3 Z3 0.1 sat ✅ 6.00000
Z3.2 sat ✅ 13.70000
SMT Evaluation 2013 0.40 (3/5) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 1363.65000
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 101.29200
CVC4-SMT-EVAL-2013 default sat ✅ 55.15260
OpenSMT OpenSMT-SMT-COMP-2010 default sat ✅ 112.70100
OpenSMT-SMT-COMP-2011 default sat ✅ 41.98980
veriT veriT-SMT-COMP-2010 default unknown ❌
veriT-SMT-COMP-2011 default unknown ❌
veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.51152
Z3-SMT-COMP-2011 default sat ✅ 0.40451
SMT-COMP 2014 CVC4 CVC4 f7118b2 default sat ✅ 124.99300 125.00600
veriT veriT-smtcomp2014 default sat ✅ 968.38600 968.79600
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.54679 0.53792
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 1.08612 1.07883
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 96.39530 96.42630
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 96.85670 96.89430
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 8.35495 15.05670
veriT veriT default sat ✅ 1257.21000 1257.73000
Yices2 Yices default sat ✅ 0.13792 0.13698
Z3 z3 4.4.0 default sat ✅ 0.67829 0.67790
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 151.99400 152.08100
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 25.74010 38.75510
veriT veriT-dev default sat ✅ 1515.28000 1516.15000
Yices2 Yices-2.4.2 default sat ✅ 0.16021 0.16029
Z3 z3-4.4.1 default sat ✅ 0.82575 0.82785
SMT-COMP 2017 0.20 (4/5) CVC4 CVC4-smtcomp2017-main default sat ✅ 107.91200 107.91100
SMTInterpol SMTInterpol default sat ✅ 47.24490 63.61530
veriT veriT-2017-06-17 default unknown ❌ 600.01800 599.97400
Yices2 Yices2-Main default sat ✅ 0.19995 0.19903
Z3 z3-4.5.0 default sat ✅ 0.81900 0.81828
SMT-COMP 2018 0.14 (6/7) CVC4 CVC4-experimental-idl-2_default sat ✅ 4.93563 4.93573
master-2018-06-10-b19c840-competition-default_default sat ✅ 159.00900 158.98500
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 604.21800 604.12700
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 21.26880 29.20020
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1199.83000
veriT veriT_default sat ✅ 831.50300 831.42500
Yices2 Yices 2.6.0_default sat ✅ 0.22440 0.22430
Z3 z3-4.7.1_default sat ✅ 0.71402 0.71396
SMT-COMP 2019 0.14 (6/7) CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 69.86560 69.85450
Par4 Par4-wrapped-sq_default sat ✅ 0.31792 0.00585
ProB ProB-wrapped-sq_default sat ✅ 5.50678 5.50738
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2422.16000
veriT veriT-wrapped-sq_default sat ✅ 1716.31000 1716.17000
Yices2 Yices 2.6.0_default sat ✅ 0.30522 0.30515
Yices 2.6.2-wrapped-sq_default sat ✅ 0.27851 0.27848
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.55062 0.55068
SMT-COMP 2023 0.17 (5/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 97.15520 97.14690
OpenSMT OpenSMT a78dcf01_default sat ✅ 174.58100 174.58400
Par4 Par4-wrapped-sq_default sat ✅ 0.27183 0.00638
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.02000 1226.68000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.23386 0.23377
Z3++ Z3++_sq_0526_default sat ✅ 0.52250 0.52256
SMT-COMP 2024 cvc5 cvc5 sat ✅ 57.36946 57.25280
OpenSMT OpenSMT sat ✅ 96.21499 96.00423
SMTInterpol SMTInterpol sat ✅ 647.38435 677.72664
Yices2 Yices2 sat ✅ 0.35141 0.25156
Z3alpha Z3-alpha sat ✅ 0.89509 0.79502