Benchmark

non-incremental/QF_IDL/asp/15Puzzle/15-puzzle.init2.smt2 

Benchmark without description.
Benchmark
Size2102383
Compressed Size296208
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2011-06-30
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 2102375
Compressed Size296194
Max. Term Depth4
Asserts 1
Declared Functions0
Declared Constants25253
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true165 not12678 or3741 and18769
=>2666 =26585 -1671 >=338

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.20 (4/5) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 18.70040 —
CVC4-SMT-EVAL-2013 default sat ✅ 36.11760 —
OpenSMT OpenSMT-SMT-COMP-2010 default unknown ❌ — —
OpenSMT-SMT-COMP-2011 default sat ✅ 422.89700 —
veriT veriT-SMT-COMP-2010 default unknown ❌ — —
veriT-SMT-COMP-2011 default unknown ❌ — —
veriT-SMT-EVAL-2013 default sat ✅ 82.50270 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 27.05690 —
Z3-SMT-COMP-2011 default sat ✅ 24.44680 —
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 76.80070 76.82530
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 77.94730 77.97810
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 238.43700 249.13000
veriT veriT default sat ✅ 70.51830 70.52630
Yices2 Yices default sat ✅ 74.17510 74.20370
Z3 z3 4.4.0 default sat ✅ 34.90080 34.91470
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 28.23820 28.25270
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 246.86800 260.98500
veriT veriT-dev default sat ✅ 66.60530 66.64500
Yices2 Yices-2.4.2 default sat ✅ 69.71360 69.75190
Z3 z3-4.4.1 default sat ✅ 54.49260 54.52960
SMT-COMP 2017 0.20 (4/5) CVC4 CVC4-smtcomp2017-main default sat ✅ 107.86700 107.82600
SMTInterpol SMTInterpol default unknown ❌ 600.01900 619.06000
veriT veriT-2017-06-17 default sat ✅ 98.40850 98.40200
Yices2 Yices2-Main default sat ✅ 37.58030 37.57690
Z3 z3-4.5.0 default sat ✅ 17.93890 17.93710
SMT-COMP 2018 CVC4 CVC4-experimental-idl-2_default unknown ❌ 1200.04000 1199.96000
master-2018-06-10-b19c840-competition-default_default sat ✅ 57.76630 57.76300
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 44.22600 44.21770
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 150.31300 167.12000
SMT-RAT SMTRAT-Rat-final_default sat ✅ 1113.74000 1113.64000
veriT veriT_default sat ✅ 78.77760 78.76290
Yices2 Yices 2.6.0_default sat ✅ 30.22960 30.22730
Z3 z3-4.7.1_default sat ✅ 17.88940 17.88510
SMT-COMP 2019 0.14 (6/7) CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 39.06820 39.06580
Par4 Par4-wrapped-sq_default sat ✅ 51.12400 201.25000
ProB ProB-wrapped-sq_default unknown ❌ 2400.11000 2399.90000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 812.00600 831.54800
veriT veriT-wrapped-sq_default sat ✅ 72.32620 72.31740
Yices2 Yices 2.6.0_default sat ✅ 37.53910 37.53700
Yices 2.6.2-wrapped-sq_default sat ✅ 37.80110 37.79580
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 33.15540 33.14990
SMT-COMP 2020 CVC4 CVC4-sq-final_default sat ✅ 42.66670 42.64410
MathSAT MathSAT5_default.sh sat ✅ 68.89070 68.88840
Par4 Par4-wrapped-sq_default sat ✅ 26.78110 105.96000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 174.32100 194.67500
veriT veriT_default sat ✅ 48.32960 48.33320
Yices2 Yices 2.6.2 bug fix_default sat ✅ 72.75690 72.74950
Z3 z3-4.8.8_default sat ✅ 37.09110 37.09040
z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 16.39880 16.39970
SMT-COMP 2021 0.25 (6/8) cvc5 cvc5-fixed_default unknown ❌ 1200.03000 1199.81000
MathSAT mathsat-5.6.6_default sat ✅ 47.42000 47.41340
OpenSMT OpenSMT-fixed_default unknown ❌ 1200.02000 1199.88000
Par4 Par4-wrapped-sq_default sat ✅ 47.95530 189.84000
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 723.28400 788.44700
veriT veriT_default sat ✅ 39.88600 39.88120
YicesLS YicesLS_0611_1448_default sat ✅ 54.01200 54.00880
Z3 z3-4.8.11_default sat ✅ 14.67150 14.66200
SMT-COMP 2025 0.50 (3/6) cvc5 cvc5 unknown ❌ 1044.79137 1046.46777
OpenSMT OpenSMT unknown ❌ 1201.96572 1201.69615
SMTInterpol SMTInterpol unknown ❌ 1201.75241 1252.74208
Yices2 Yices2 sat ✅ 46.36360 46.23641
Z3alpha Z3-alpha sat ✅ 16.84023 63.78321
Z3 Z3-alpha-base sat ✅ 99.53699 99.39327