Benchmark

non-incremental/QF_IDL/queens_bench/super_queen/super_queen58-1.smt2

Queens benchmarks generated by Hyondeuk Kim in SMT-LIB format.
Benchmark
Size146384
Compressed Size22170
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2006-08-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 146376
Compressed Size21780
Max. Term Depth5
Asserts 1
Declared Functions0
Declared Constants59
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not5185 and1 =5185 let1
-3477 <=58 >=58

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.40 (3/5) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 30.71900
CVC4-SMT-EVAL-2013 default sat ✅ 64.59450
OpenSMT OpenSMT-SMT-COMP-2010 default sat ✅ 26.98870
OpenSMT-SMT-COMP-2011 default sat ✅ 46.80830
veriT veriT-SMT-COMP-2010 default unknown ❌
veriT-SMT-COMP-2011 default unknown ❌
veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.38938
Z3-SMT-COMP-2011 default sat ✅ 0.75420
SMT-COMP 2014 CVC4 CVC4 f7118b2 default sat ✅ 92.27650 92.27900
veriT veriT-smtcomp2014 default sat ✅ 445.04000 445.21600
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 0.17365 0.16497
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.71381 0.70589
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 65.12210 65.14710
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 65.26990 65.29410
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 15.52040 24.82420
veriT veriT default sat ✅ 558.27000 558.44800
Yices2 Yices default sat ✅ 0.19859 0.19797
Z3 z3 4.4.0 default sat ✅ 0.51571 0.51592
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 75.88570 75.90860
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 15.34870 26.46980
veriT veriT-dev default sat ✅ 405.72900 405.95200
Yices2 Yices-2.4.2 default sat ✅ 0.16466 0.16472
Z3 z3-4.4.1 default sat ✅ 0.96785 0.96958
SMT-COMP 2017 0.20 (4/5) CVC4 CVC4-smtcomp2017-main default sat ✅ 74.89440 74.86300
SMTInterpol SMTInterpol default sat ✅ 8.42781 20.36150
veriT veriT-2017-06-17 default unknown ❌ 600.04900 599.98200
Yices2 Yices2-Main default sat ✅ 0.23336 0.22741
Z3 z3-4.5.0 default sat ✅ 0.89989 0.89929
SMT-COMP 2018 0.14 (6/7) CVC4 CVC4-experimental-idl-2_default sat ✅ 18.01290 18.01390
master-2018-06-10-b19c840-competition-default_default sat ✅ 65.25030 65.22740
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 638.68200 638.61700
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 7.43085 14.17240
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.05000 1200.01000
veriT veriT_default sat ✅ 507.71900 507.65400
Yices2 Yices 2.6.0_default sat ✅ 0.12807 0.12800
Z3 z3-4.7.1_default sat ✅ 0.46494 0.46471
SMT-COMP 2020 CVC4 CVC4-sq-final_default sat ✅ 33.32630 33.32100
MathSAT MathSAT5_default.sh sat ✅ 595.41000 595.38900
Par4 Par4-wrapped-sq_default sat ✅ 0.15677 0.00920
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 196.14900 213.99200
veriT veriT_default sat ✅ 160.71200 160.69300
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.14002 0.13995
Z3 z3-4.8.8_default sat ✅ 0.47758 0.47752
z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 0.44398 0.44395
SMT-COMP 2021 cvc5 cvc5-fixed_default sat ✅ 52.52940 52.52980
MathSAT mathsat-5.6.6_default sat ✅ 459.10800 458.96500
OpenSMT OpenSMT-fixed_default sat ✅ 332.78900 332.78200
Par4 Par4-wrapped-sq_default sat ✅ 0.16628 0.00642
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 507.59800 527.06100
veriT veriT_default sat ✅ 87.03580 87.01870
YicesLS YicesLS_0611_1448_default sat ✅ 0.17983 0.03284
Z3 z3-4.8.11_default sat ✅ 0.58966 0.58808
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 44.40300 44.39830
MathSAT MathSAT-5.6.8_default sat ✅ 196.48600 196.43100
Par4 Par4-wrapped-sq_default sat ✅ 0.18789 0.00736
veriT veriT_default sat ✅ 129.70600 129.70200
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.17102 0.17098
Z3 z3-4.8.17_default sat ✅ 7.30113 7.30280
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 72.81810 72.81580
OpenSMT OpenSMT a78dcf01_default sat ✅ 151.13800 151.13300
Par4 Par4-wrapped-sq_default sat ✅ 0.19903 0.00957
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 455.99500 480.73500
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.16892 0.16887
Z3++ Z3++_sq_0526_default sat ✅ 0.37320 0.37328
SMT-COMP 2025 0.17 (5/6) cvc5 cvc5 sat ✅ 18.32853 18.19760
OpenSMT OpenSMT sat ✅ 74.49912 74.37431
SMTInterpol SMTInterpol unknown ❌ 3.76440 10.85215
Yices2 Yices2 sat ✅ 0.35015 0.23065
Z3alpha Z3-alpha sat ✅ 0.72394 1.61763
Z3 Z3-alpha-base sat ✅ 0.68573 0.56713