Benchmark

non-incremental/QF_BV/ecc/com.galois.ecc.P384ECC64.ec_twin_mul_aux24.short.smt2 

These benchmarks are derived from a semi-automated proof of functional equivalence between two implementations of an Elliptic Curve Digital Signature Algorithm (ECDSA). More information about problem they encode can be found here: http://cps-vo.org/node/3405
Benchmark
Size465751
Compressed Size54733
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 465743
Compressed Size54744
Max. Term Depth7
Asserts 6116
Declared Functions0
Declared Constants6130
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite879 not633 or969
and984 =>1 =7162 concat6
extract3 bvnot632 bvand1012 bvor971
bvxor2 bvneg2 bvsub23 bvult56
bvule48 bvsle1332 bvshl2 bvlshr2
zero_extend2

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 4Simp 4Simp - 2014 default unsat ✅ 0.21865 0.20897
Abziz abziz_portfolio_all_features default unsat ✅ 0.41469 0.40994
abziz_portfolio_min_features default unsat ✅ 0.42011 0.40694
Boolector Boolector boolector unsat ✅ 0.13406 0.12398
CVC4 CVC4 f7118b2 default unsat ✅ 0.84210 1.37379
MathSAT MathSAT-5.2.12-Main default unsat ✅ 0.15906 0.15698
SONOLAR sonolar_smtcomp-2014 default unsat ✅ 0.21323 0.20997
STP stp-cryptominisat4 default unsat ✅ 0.22899 0.22797
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 0.04297 0.03399
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.22167 0.21197
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.11697 0.11598
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.90326 1.49277
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.89948 1.48577
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.17514 0.17397
SMT-RAT SMT-RAT-final default unsat ✅ 19.66900 19.67200
STP stp-cryptominisat4 default unsat ✅ 0.20714 0.20597
stp-cmsat4-v15 default unsat ✅ 0.20798 0.20697
stp-cmsat4-mt-v15 default unknown ❌ 0.21718 0.21597
stp-minisat-v15 default unsat ✅ 0.20578 0.20497
Yices2 Yices default unsat ✅ 0.03315 0.03199
Z3 z3 4.4.0 default unsat ✅ 0.15328 0.15298
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.66819 0.66824
ABC_glucose glucose unsat ✅ 4.15398 4.15641
Boolector Boolector boolector unsat ✅ 0.19689 0.19698
Boolector preprop boolector unsat ✅ 0.22806 0.22818
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.87428 1.43264
MapleSTP MapleSTP default unsat ✅ 0.22741 0.22753
MapleSTP-mt default unsat ✅ 0.23264 0.29664
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.15442 0.15552
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.28893 0.32414
Q3B Q3B default unknown ❌ 2400.09000 7204.76000
STP stp-cms-exp-2016 default unsat ✅ 0.22842 0.22853
stp-cms-mt-2016 default unsat ✅ 0.23335 0.30013
stp-cms-st-2016 default unsat ✅ 0.22854 0.22880
stp-minisat-st-2016 default unsat ✅ 0.24052 0.24065
Yices2 Yices-2.4.2 default unsat ✅ 0.03344 0.03340
Z3 z3-4.4.1 default unsat ✅ 0.18101 0.18226
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.40905 0.40789
Boolector SMT17 final boolector unsat ✅ 0.45389 0.45382
CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.90075 1.47944
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.15631 0.15578
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.31384 0.28139
Q3B Q3B default unknown ❌ 600.02100 1799.72000
STP stp_st default unsat ✅ 0.23219 0.23170
stp_mt default unsat ✅ 0.23995 0.31024
Yices2 Yices2-Main default unsat ✅ 0.03787 0.03170
Z3 z3-4.5.0 default unsat ✅ 0.18287 0.17828
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.33025 0.33018
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.74974 1.74991
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.15373 0.15481
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.28745 0.29761
Minkeyrink ST_st unsat ✅ 0.29274 0.29286
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.21620 0.21642
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.22030 0.23178
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.38628 0.38638
Yices2 Yices 2.6.0_default unsat ✅ 0.03570 0.03565
Z3 z3-4.7.1_default unsat ✅ 0.21773 0.21761
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.48465 0.48468
Poolector-wrapped-sq_default unsat ✅ 0.37722 0.56240
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.23240 0.23239
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.05122 1.05141
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.31803 0.32523
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.31252 0.31261
Par4 Par4-wrapped-sq_default unsat ✅ 0.04506 0.00647
STP STP-2019-wrapped-sq_default unsat ✅ 0.22221 0.22259
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.24438 0.24462
stp-minisat-wrapped-sq_default unsat ✅ 0.22062 0.22083
stp-mt-wrapped-sq_default unsat ✅ 0.22751 0.24039
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.27484 0.30302
stp-riss-wrapped-sq_default unknown ❌ 0.21485 0.21505
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03496 0.03493
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03607 0.03609
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03780 0.03779
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 7.04885 7.04892
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03512 0.03499
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.19421 0.19423
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.48077 0.48074
MathSAT mathsat-5.6.6_default unsat ✅ 0.12907 0.12897
STP STP 2021.0_default unsat ✅ 0.20997 0.22078
Z3 z3-4.8.11_default unsat ✅ 0.13375 0.13368
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.39374 0.29389
cvc5 cvc5 unsat ✅ 0.84196 0.74173
SMTInterpol SMTInterpol unknown ❌ 1201.72284 1245.21256
STP STP unsat ✅ 0.38149 0.28119
Yices2 Yices2 unsat ✅ 0.23531 0.13497
Z3alpha Z3-alpha unsat ✅ 0.33930 0.23988
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.36913 0.25290
Bitwuzla-MachBV-base unsat ✅ 0.43805 0.31154
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.50996 0.38730
BVDecide bv_decide unsat ✅ 310.24096 310.05126
bv_decide-nokernel unsat ✅ 36.75106 36.56333
cvc5 cvc5 unsat ✅ 0.66509 0.53401
SMTInterpol SMTInterpol unknown ❌ 1201.78824 1230.79742
Yices2 Yices2 unsat ✅ 0.31161 0.19318
Z3alpha Z3-alpha unsat ✅ 0.65775 1.13918
Z3 Z3-alpha-base unsat ✅ 0.38803 0.26703
Z3-Owl-base unsat ✅ 0.78928 0.67020
z3siri-base unsat ✅ 0.35991 0.24345
Z3-Owl Z3-Owl unsat ✅ 1.90867 1.77468