Benchmark

non-incremental/UFNIA/spec_sharp/test14-DafnyAst.ssc.80.Microsoft.Dafny.TypeRhs..ctor_Microsoft.Dafny.Type_notnull.smt2

Spec# benchmarks.  Contributed by Leonardo de Moura and Michal Moskal.
Benchmark
Size395064
Compressed Size35372
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 395056
Compressed Size35360
Max. Term Depth84
Asserts 3
Declared Functions164
Declared Constants364
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true116 not4717 or549 =>584
=3527 distinct2 forall479 let209
Int893 +9 -15 *2
<22 <=63 >1 >=5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unsat ✅ 1072.93000
CVC3-SMT-COMP-2012 default unsat ✅ 1203.89000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.48831
Z3-SMT-COMP-2011 default unsat ✅ 0.39896
SMT-COMP 2014 CVC3 CVC3 default unsat ✅ 1548.76000 1549.35000
CVC4 CVC4 f7118b2 default unsat ✅ 8.52084 8.51970
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.73718 0.72889
SMT-COMP 2015 CVC3 CVC3 default unsat ✅ 194.78600 194.77200
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 339.21500 339.21700
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 371.26000 371.35100
Z3 z3 4.4.0 default unsat ✅ 0.47385 0.47393
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 18.06840 18.08060
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 3.11864 3.13405
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 2.19947 8.33000
Z3 z3-4.4.1 default unsat ✅ 0.60896 0.61060
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 442.81000 437.80000
Vampire vampire4.2-smt vampire unsat ✅ 2.33092 8.95000
Z3 z3-4.5.0 default unsat ✅ 0.67510 0.67336
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 13.80170 13.80220
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 19.61280 77.51000
Z3 z3-4.7.1_default unsat ✅ 0.41301 0.41293
SMT-COMP 2019 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.08000 9525.90000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 21.19630 21.19490
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 22.35710 22.35450
Par4 Par4-wrapped-sq_default unsat ✅ 0.51507 0.00606
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2400.08000 2600.58000
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2400.02000 2594.32000
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 24.25130 95.35840
vampire-4.3-smt_vampire_smtcomp unsat ✅ 21.57820 115.56600
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.42729 0.42726
z3-4.7.1_default unsat ✅ 0.50362 0.50354
SMT-COMP 2021 0.29 (5/7) CVC4 CVC4-sq-final_default unsat ✅ 17.73770 17.73560
cvc5 cvc5-fixed_default unsat ✅ 21.51520 21.50440
Par4 Par4-wrapped-sq_default unsat ✅ 0.46283 0.00632
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.70822 1.79250
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 1200.04000 1212.87000
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 6.41126 24.98000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 7.25866 32.33000
Z3 z3-4.8.11_default unsat ✅ 0.73046 0.73040
SMT-COMP 2023 0.25 (3/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 11.00640 11.00620
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.03000 1183.18000
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 310.45600 1214.60000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 1200.07000 1217.28000
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 18.18440 71.39000