Benchmark

non-incremental/UFLIA/tokeneer/auditlog/archivelog-25.smt2

Tokeneer case study <http://www.adacore.com/home/products/gnatpro/tokeneer/>
Benchmark
Size29349
Compressed Size3935
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 29341
Compressed Size3949
Max. Term Depth11
Asserts 243
Declared Functions51
Declared Constants206
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true12 not7 or2 and45
=>35 =154 distinct3 forall46
let11 Int69 +15 -15
<30 <=161

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 CVC3 CVC3 2.0 unsat ✅ 2.80000
Z3 Z3.2 unsat ✅
SMT Evaluation 2013 CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 1.96838
CVC3-SMT-COMP-2011 default unsat ✅ 1.78942
CVC3-SMT-COMP-2012 default unsat ✅ 1.72929
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.04314
CVC4-SMT-EVAL-2013 default unsat ✅ 0.04206
veriT veriT-SMT-EVAL-2013 default unsat ✅ 0.15009
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.01878
Z3-SMT-COMP-2011 default unsat ✅ 0.02841
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unknown ❌ 0.00862 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.05760 0.05499
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.05787 0.05499
veriT veriT default unsat ✅ 0.30765 0.30695
Z3 z3 4.4.0 default unsat ✅ 0.04961 0.04999
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.05401 0.05419
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.79946 2.81196
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.46291 0.26543
veriT veriT-dev default unsat ✅ 0.07946 0.07939
Z3 z3-4.4.1 default unsat ✅ 0.04982 0.05098
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.06077 0.05632
Vampire vampire4.2-smt vampire unsat ✅ 3.51670 13.73000
veriT veriT-2017-06-17 default unsat ✅ 0.09152 0.09113
Z3 z3-4.5.0 default unsat ✅ 0.05445 0.05350
SMT-COMP 2018 CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.06108 0.06130
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.74526 2.58000
veriT veriT_default unsat ✅ 0.08226 0.08246
Z3 z3-4.7.1_default unsat ✅ 0.06063 0.06055
SMT-COMP 2019 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.35948 0.36016
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.06652 0.06686
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.06393 0.06421
Par4 Par4-wrapped-sq_default unsat ✅ 0.07224 0.00582
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.03000 2423.63000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.54516 3.77156
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.30153 3.46312
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.49559 3.77180
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.14322 0.14316
veriT veriT-wrapped-sq_default unsat ✅ 0.10953 0.10991
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.06663 0.06664
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.35735 0.35364
CVC4 CVC4-sq-final_default unsat ✅ 0.07159 0.07191
Par4 Par4-wrapped-sq_default unsat ✅ 0.07146 0.00680
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.02000 1213.47000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.57000 3.82731
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.16578 0.17606
veriT veriT_default unsat ✅ 0.05182 0.05217
veriT+vite_default unsat ✅ 0.03957 0.03992
Z3 z3-4.8.8_default unsat ✅ 0.06078 0.06073
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 0.09711 0.09529
cvc5 cvc5-fixed_default unsat ✅ 0.06878 0.06936
Par4 Par4-wrapped-sq_default unsat ✅ 0.11318 0.01132
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 440.22400 484.16200
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.24726 5.79626
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.11804 0.11792
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.24012 0.20186
veriT veriT_default unsat ✅ 0.03662 0.03700
Z3 z3-4.8.11_default unsat ✅ 0.04669 0.04666
z3-4.8.8_default unsat ✅ 0.06113 0.06107
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.07263 0.07297
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.15889 0.15929
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.00398 4.91071
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.22386 0.24402
veriT veriT_default unsat ✅ 0.09181 0.09219
Z3 z3-4.8.17_default unsat ✅ 0.04968 0.05148
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 0.30898 0.18919
iProver iProver v3.9.3 unsat ✅ 22.46850 79.49796
SMTInterpol SMTInterpol unsat ✅ 55.20435 75.10918
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.01446 4.30290