Benchmark

non-incremental/QF_BV/calypto/problem_20.smt2 

Sequential equivalence checking.
    Calypto Design Systems, Inc. <www.calypto.com>
Benchmark
Size23910
Compressed Size3898
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 23902
Compressed Size3908
Max. Term Depth128
Asserts 1
Declared Functions0
Declared Constants33
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true24 false24 ite428 not13
and34 =310 let109 concat80
extract120 bvand13 bvxor16 bvadd13
bvult3 bvshl3 bvlshr12 sign_extend5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2012 0.43 (4/7) 4Simp 4Simp unsat ✅ 181.00000 —
Abziz AbzizPortfolio+BOOLECTOR+MATHSAT+SONOLAR+STP2+Z3_6 unsat ✅ 356.30000 —
Boolector Boolector unknown ❌ 1200.00000 —
CVC3 CVC3 v2.4.2 unknown ❌ — —
CVC4 1.0rc.3931 unsat ✅ 7.60000 —
MathSAT MathSAT-HeavyBV unknown ❌ 1200.00000 —
SONOLAR SONOLAR unknown ❌ 1200.00000 —
Z3 Z3 unsat ✅ 156.10000 —
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 90.25590 —
Abziz abziz_portfolio_2011_minfeatures_2 default unknown ❌ — —
abziz_portfolio_2011_solvers_2 default unsat ✅ 393.87400 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default unsat ✅ 14.62380 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 12.60420 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 614.08800 —
Boolector-SMT-COMP-2011 default unsat ✅ 393.73800 —
Boolector-SMT-COMP-2012 default unsat ✅ 1310.85000 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.62567 —
CVC4-SMT-EVAL-2013 default unsat ✅ 18.71750 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 4.10427 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unsat ✅ 7.43101 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 10.21130 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 529.67100 —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unknown ❌ — —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unsat ✅ 268.04000 —
STP2-SMT-COMP-2012 default unsat ✅ 90.17520 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 81.42100 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 1437.23000 —
Z3-SMT-COMP-2011 default unsat ✅ 100.30300 —
SMT-COMP 2015 0.29 (5/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 19.65570 19.66300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 5.41955 10.83240
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 5.35712 10.70640
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 4.69910 4.70029
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.77000
STP stp-cryptominisat4 default unsat ✅ 158.61000 158.64800
stp-cmsat4-v15 default unsat ✅ 27.50570 27.51080
stp-cmsat4-mt-v15 default unknown ❌ 0.09268 0.09098
stp-minisat-v15 default unknown ❌ 2400.01000 2400.74000
Yices2 Yices default unknown ❌ 2400.01000 2400.91000
Z3 z3 4.4.0 default unsat ✅ 1160.52000 1160.89000
SMT-COMP 2016 0.20 (8/10) ABC ABC_default default_abc unsat ✅ 111.72700 111.79000
ABC_glucose glucose unsat ✅ 33.00280 33.02180
Boolector Boolector boolector unsat ✅ 5.88403 5.88788
Boolector preprop boolector unsat ✅ 5.82832 5.83207
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 124.58000 250.08000
MapleSTP MapleSTP default unsat ✅ 1372.35000 1373.04000
MapleSTP-mt default unsat ✅ 281.53600 1116.10000
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 55.41300 55.44560
MinkeyRink Minkeyrink 2016 default unsat ✅ 9.72492 37.25190
Q3B Q3B default unknown ❌ 2400.04000 7203.95000
STP stp-cms-exp-2016 default unsat ✅ 110.60900 110.66400
stp-cms-mt-2016 default unsat ✅ 11.77250 46.54720
stp-cms-st-2016 default unsat ✅ 27.13580 27.15370
stp-minisat-st-2016 default unknown ❌ 2400.08000 2401.67000
Yices2 Yices-2.4.2 default unknown ❌ 2400.01000 2401.33000
Z3 z3-4.4.1 default unsat ✅ 1072.68000 1073.26000
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 2.82822 2.82723
Boolector SMT17 final boolector unsat ✅ 11.82750 8.19253
CVC4 CVC4-smtcomp2017-main default unsat ✅ 210.42000 422.19000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 67.09910 67.09510
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 34.93250 65.45000
Q3B Q3B default unknown ❌ 600.03300 1799.43000
STP stp_st default unsat ✅ 22.72770 22.72560
stp_mt default unsat ✅ 10.25830 40.52500
Yices2 Yices2-Main default unknown ❌ 600.01200 599.94800
Z3 z3-4.5.0 default unknown ❌ 600.01100 599.93900
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default unsat ✅ 2.15221 2.15208
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.44723 5.44735
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 84.89440 84.88090
MinkeyRink Minkeyrink MT_mt unsat ✅ 12.15210 48.03340
Minkeyrink ST_st unsat ✅ 14.89480 14.89500
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 15.62440 15.62200
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 12.18610 48.21910
STP-Riss-st-2018_riss-no-stderr unsat ✅ 12.59500 12.59290
Yices2 Yices 2.6.0_default unknown ❌ 1200.02000 1199.93000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.98000
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 3.66694 3.66670
Poolector-wrapped-sq_default unsat ✅ 3.95992 15.31000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 8.59500 8.59440
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 17.41380 17.41480
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 12.60230 49.79850
MinkeyRink ST-wrapped-sq_default unsat ✅ 15.99680 15.99590
Par4 Par4-wrapped-sq_default unsat ✅ 2.10327 6.12000
STP STP-2019-wrapped-sq_default unsat ✅ 16.51490 16.51540
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 71.11370 71.10630
stp-minisat-wrapped-sq_default unknown ❌ 2400.03000 2399.95000
stp-mt-wrapped-sq_default unsat ✅ 11.48720 45.24410
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.05000 2489.17000
stp-riss-wrapped-sq_default unknown ❌ 0.08841 0.08862
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.05000 2399.53000
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 46.39930 46.39690
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 20.65630 20.65740
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 19.76460 19.76330
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 23.85590 23.85530
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1073.73000 1073.71000
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 2.29510 2.19434
cvc5 cvc5 unsat ✅ 17.17847 17.07403
SMTInterpol SMTInterpol unknown ❌ 1201.77050 1264.50377
STP STP unsat ✅ 7.74114 7.63931
Yices2 Yices2 unsat ✅ 16.55296 16.45194
Z3alpha Z3-alpha unsat ✅ 10.02467 9.92155
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 2.62148 2.50540
Bitwuzla-MachBV-base unsat ✅ 2.00441 1.88734
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 3.25278 3.12843
BVDecide bv_decide unsat ✅ 9.55754 9.38512
bv_decide-nokernel unsat ✅ 6.31834 6.14525
cvc5 cvc5 unsat ✅ 12.39738 12.25903
SMTInterpol SMTInterpol unsat ✅ 576.17455 626.86089
Yices2 Yices2 unsat ✅ 7.42528 7.29543
Z3alpha Z3-alpha unsat ✅ 50.60524 200.95220
Z3 Z3-alpha-base unsat ✅ 76.93054 76.80041
Z3-Owl-base unsat ✅ 411.35187 411.18864
z3siri-base unsat ✅ 79.61272 79.45907
Z3-Owl Z3-Owl unsat ✅ 310.52862 310.37092