Benchmark

non-incremental/QF_NIA/calypto/problem-000168.cvc.1.smt2

Sequential equivalence checking.
    Calypto Design Systems, Inc. <www.calypto.com>
Benchmark
Size1740
Compressed Size648
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1732
Compressed Size662
Max. Term Depth16
Asserts 23
Declared Functions0
Declared Constants14
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite8 not1 and1 =2
let4 +16 -6 *8
<4 <=22 >=2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 Barcelogic barcelogic-QF_NIA sat ✅
CVC3 CVC3 2.0 sat ✅ 0.20000
SMT-COMP 2010 0.25 (3/4) AProVE AProVE NIA 0.2.1 sat ✅ 4.50000
Barcelogic barcelogic-QF_NIA sat ✅ 0.10000
CVC3 CVC3 2.3 unknown ❌ 0.10000
MiniSmt MiniSmt sat ✅ 8.30000
SMT-COMP 2011 0.25 (3/4) AProVE AProVE NIA 0.3 sat ✅ 1.80000
CVC3 CVC3 v2.4 unknown ❌
MiniSmt MiniSmt sat ✅ 4.80000
Z3 Z3 sat ✅ 0.20000
SMT Evaluation 2013 0.25 (3/4) AProVE AProVE-NIA-SMT-COMP-2010 default sat ✅ 0.99344
AProVE-NIA-SMT-COMP-2011 default sat ✅ 1.05813
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 0.05492
CVC3-SMT-COMP-2011 default unknown ❌ 0.05019
CVC3-SMT-COMP-2012 default unknown ❌ 0.05089
MiniSmt MiniSMT-0.5-SMT-EVAL-2013 default sat ✅ 4.27447
MiniSMT-SMT-COMP-2010 default sat ✅ 3.84017
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 0.09249
Z3-SMT-COMP-2011 default sat ✅ 0.22043
SMT-COMP 2014 0.50 (2/4) AProVE AProVE NIA 2014 default sat ✅ 1.07467 2.22666
CVC3 CVC3 default unknown ❌ 0.07234 0.07199
CVC4 CVC4 f7118b2 default unknown ❌ 0.02237 0.01200
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 0.09828 0.08599
SMT-COMP 2015 0.50 (3/6) AProVE AProVE NIA 2014 default sat ✅ 0.99656 2.04569
CVC3 CVC3 default unknown ❌ 0.10250 0.10198
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 0.01525 0.01300
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 0.15869 0.15198
raSAT raSAT default.sh unknown ❌ 650.12100 650.13000
SMT-RAT SMT-RAT-final default sat ✅ 0.80463 0.80388
SMT-RAT-NIA-Parallel-final default sat ✅ 1.25774 2.47262
Z3 z3 4.4.0 default sat ✅ 0.11593 0.11598
SMT-COMP 2016 0.29 (5/7) AProVE AProVE NIA 2014 default sat ✅ 0.71776 1.63784
CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 0.14617 0.14695
ProB ProB competition sat ✅ 0.97286 0.97367
raSAT raSAT 0.3 default.sh unknown ❌ 64.27390 64.26000
raSAT 0.4 exp - final default.py unknown ❌ 54.93420 110.30000
SMT-RAT SMT-RAT default sat ✅ 0.34144 0.34161
Yices2 Yices-2.4.2 default sat ✅ 0.01245 0.00575
Z3 z3-4.4.1 default sat ✅ 0.10859 0.10986
SMT-COMP 2017 AProVE AProVE NIA 2014 default sat ✅ 0.99348 1.90218
CVC4 CVC4-smtcomp2017-main default sat ✅ 0.02539 0.02485
SMT-RAT SMTRAT-comp2017_2 default sat ✅ 0.52678 0.52614
Yices2 Yices2-Main default sat ✅ 0.00741 0.00496
Z3 z3-4.5.0 default sat ✅ 0.08554 0.08452
SMT-COMP 2018 AProVE AProVE NIA 2014_default sat ✅ 0.72043 1.73365
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 0.02559 0.02578
SMT-RAT SMTRAT-Rat-final_default sat ✅ 0.43570 0.43558
Yices2 Yices 2.6.0_default sat ✅ 0.00902 0.00796
Z3 z3-4.7.1_default sat ✅ 0.29229 0.29217
SMT-COMP 2019 AProVE AProVE NIA 2014-wrapped-sq_default sat ✅ 0.75648 1.80743
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 0.02951 0.02989
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 0.11320 0.11519
master-2018-06-10-b19c840-competition-default_default sat ✅ 0.02546 0.02571
MathSAT mathsat-20190601-wrapped-sq_default sat ✅ 0.02948 0.02948
mathsat-na-20190601-wrapped-sq_default sat ✅ 0.02960 0.02957
Par4 Par4-wrapped-sq_default sat ✅ 0.02158 0.00569
ProB ProB-wrapped-sq_default sat ✅ 1.53627 1.53660
SMT-RAT SMTRAT-5-wrapped-sq_default sat ✅ 0.16911 0.16910
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.00903 0.00872
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1.15786 1.15777
SMT-COMP 2020 AProVE AProVE NIA 2014_default sat ✅ 0.77444 1.81127
CVC4 CVC4-sq-final_default sat ✅ 0.02813 0.02845
MathSAT MathSAT5_default.sh sat ✅ 0.02886 0.02881
Par4 Par4-wrapped-sq_default sat ✅ 0.01842 0.00679
SMT-RAT smtrat-SMTCOMP_default sat ✅ 0.44951 0.44946
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.01344 0.01340
Z3 z3-4.8.8_default sat ✅ 3.51355 3.51229
SMT-COMP 2021 AProVE AProVE NIA 2014_2021 sat ✅ 0.74699 1.78985
cvc5 cvc5-fixed_default sat ✅ 0.03333 0.03387
MathSAT mathsat-5.6.6_default sat ✅ 0.03096 0.03092
Par4 Par4-wrapped-sq_default sat ✅ 0.01691 0.00640
SMT-RAT smtrat-SMTCOMP_default sat ✅ 0.49167 0.49153
smtrat-SMTCOMP_default sat ✅ 0.46298 0.46289
Z3 z3-4.8.11_default sat ✅ 0.44808 0.44801
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 0.06231 0.06278
MathSAT MathSAT-5.6.8_default sat ✅ 0.03911 0.03873
Par4 Par4-wrapped-sq_default sat ✅ 0.01840 0.00625
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.01397 0.01394
Yices-ismt yices-ismt-0721_default sat ✅ 0.01951 0.01968
Z3 z3-4.8.17_default sat ✅ 0.25554 0.25729
Z3++ z3++0715_default sat ✅ 0.20130 0.20131
SMT-COMP 2024 0.25 (3/4) cvc5 cvc5 sat ✅ 0.23266 0.13308
SMTInterpol SMTInterpol unknown ❌ 0.44336 0.50035
Yices2 Yices2 sat ✅ 0.21763 0.11906
Z3alpha Z3-alpha sat ✅ 0.39062 0.29050