Benchmark

non-incremental/QF_LRA/sc/sc-33.base.cvc.smt2

Fully parameterized specification and verification of a synchronizer   
circuit modeling metastability at various levels of refinement.     
A paper describing this specification, to be published in Designing     
Correct Circuits (DCC), 2006, is available from the authors.            

Geoffrey Brown, Indiana University <geobrown@cs.indiana.edu>
Lee Pike, Galois Connections, Inc. <leepike@galois.com>

Translated into CVC format by Leonardo de Moura.

This benchmark was automatically translated into SMT-LIB format from
CVC format using CVC Lite
Benchmark
Size71800
Compressed Size14127
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2006-08-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 71792
Compressed Size14152
Max. Term Depth184
Asserts 1
Declared Functions0
Declared Constants608
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite66 not269 or429 and1799
xor100 =1486 let35 +132
<4 <=228 >2 >=6

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2007 0.33 (4/6) Argo-Lib ArgoLib v3.5 unknown ❌ 1800.80000
Barcelogic Barcelogic 1.2 unsat ✅ 432.50000
CVC3 CVC3 1.2 unknown ❌ 0.30000
CVC3 1.2 (patched) unknown ❌ 1472.80000
MathSAT MathSAT 4.0 unsat ✅ 51.60000
Yices Yices 1.0 unsat ✅ 7.50000
Yices 1.0.10 unsat ✅ 8.30000
Z3 Z3 0.1 unsat ✅ 9.10000
SMT-COMP 2008 0.17 (5/6) Barcelogic Barcelogic 1.3 unsat ✅ 67.90000
CVC3 CVC3-1.5 unknown ❌ 1201.00000
MathSAT MathSAT-4.2 unsat ✅ 18.00000
Yices2 Yices2 (proto c) unsat ✅ 34.80000
Yices Yices 1.0.10 unsat ✅ 6.70000
Z3 Z3.2 unsat ✅ 10.30000
SMT-COMP 2010 0.25 (3/4) CVC3 CVC3 2.3 unknown ❌ 1062.30000
CVC4 CVC4 1.0a0 unsat ✅ 355.90000
OpenSMT OpenSMT-1.0-alpha unsat ✅ 412.20000
Yices2 Yices 2 proto unsat ✅ 24.80000
Yices2 (proto c) unsat ✅ 30.70000
SMT-COMP 2011 0.29 (5/7) CVC3 CVC3 v2.4 unknown ❌ 1200.20000
CVC4 CVC4 1.0rc.2026 unsat ✅ 17.60000
MathSAT MathSAT 5 unsat ✅ 26.90000
MathSAT5 unsat ✅ 36.30000
OpenSMT opensmt unsat ✅ 147.20000
SMTInterpol SMTInterpol 2.0pre unknown ❌ 1200.20000
Yices2 smtlib2parser+Yices 1.0.29 unsat ✅ 13.70000
Z3 Z3 unsat ✅ 39.50000
SMT Evaluation 2013 0.14 (6/7) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2010 default unsat ✅ 550.44300
CVC4-SMT-COMP-2011 default unsat ✅ 7.93950
CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 21.85220
CVC4-SMT-EVAL-2013 default unsat ✅ 23.97710
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 19.80220
MathSAT5-SMT-COMP-2010 default unsat ✅ 21.75890
MathSAT5-SMT-COMP-2011 default unsat ✅ 21.68270
MathSAT5-SMT-COMP-2012 default unsat ✅ 22.70350
test_pmathsat-SMT-COMP-2010 default unsat ✅ 21.39760
OpenSMT OpenSMT-SMT-COMP-2010 default unsat ✅ 383.67000
OpenSMT-SMT-COMP-2011 default unsat ✅ 51.58650
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default unsat ✅ 690.28000
SMTInterpol-SMT-COMP-2011 default unsat ✅ 467.13000
SMTInterpol-SMT-COMP-2012 default unsat ✅ 546.02200
veriT veriT-SMT-EVAL-2013 default unsat ✅ 351.58100
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 13.94580
Z3-SMT-COMP-2011 default unsat ✅ 24.58040
SMT-COMP 2014 CVC4 CVC4 f7118b2 default unsat ✅ 39.22930 39.21600
MathSAT MathSAT-5.2.12-Main default unsat ✅ 20.87470 20.86880
SMTInterpol smtinterpol-2.1-118-g3dada2f default unsat ✅ 805.72700 941.21300
veriT veriT-smtcomp2014 default unsat ✅ 11.06590 11.06130
Yices2 Yices-2.2.1-smtcomp2014 default unsat ✅ 28.92730 28.93360
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 27.83500 27.83380
SMT-COMP 2015 0.29 (5/7) CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 46.71540 46.73190
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 46.65650 46.67690
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 20.61550 20.62490
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unknown ❌ 2400.02000 2413.60000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.77000
veriT veriT default unsat ✅ 14.83570 14.83770
Yices2 Yices default unsat ✅ 41.03860 41.05480
Z3 z3 4.4.0 default unsat ✅ 30.16630 30.17840
SMT-COMP 2016 0.22 (7/9) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 36.91010 36.92300
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 21.21300 42.42770
OpenSMT OpenSMT2-2016-05-12 default unsat ✅ 29.15980 29.17630
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 416.37400 489.84400
SMT-RAT SMT-RAT default unknown ❌ 2400.02000 2401.29000
Toysmt toysmt default unknown ❌ 0.13022 0.13028
veriT veriT-dev default unsat ✅ 15.85440 15.86270
Yices2 Yices-2.4.2 default unsat ✅ 42.49930 42.52480
Z3 z3-4.4.1 default unsat ✅ 16.93490 16.94680
SMT-COMP 2017 0.12 (7/8) CVC4 CVC4-smtcomp2017-main default unsat ✅ 30.67200 30.66960
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 22.04790 22.03690
OpenSMT opensmt2-2017-06-04 default unsat ✅ 28.08560 28.08340
SMTInterpol SMTInterpol default unsat ✅ 562.32000 640.89500
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.03500 599.98700
veriT veriT-2017-06-17 default unsat ✅ 16.39260 16.39160
Yices2 Yices2-Main default unsat ✅ 39.91150 39.91200
Z3 z3-4.5.0 default unsat ✅ 16.06080 16.06110
SMT-COMP 2018 0.33 (6/9) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default unknown ❌ 1200.07000 4775.86000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 38.72120 38.71780
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 37.42090 37.41830
OpenSMT opensmt2_default unsat ✅ 23.99280 23.99300
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unknown ❌ 1200.06000 1431.05000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.04000 1200.04000
SMTRAT-MCSAT-final_default unknown ❌ 1200.06000 1199.98000
veriT veriT_default unsat ✅ 11.93840 11.93800
Yices2 Yices 2.6.0_default unsat ✅ 36.89930 36.89620
Z3 z3-4.7.1_default unsat ✅ 21.45510 21.45540
SMT-COMP 2021 0.33 (4/6) MathSAT mathsat-5.6.6_default unsat ✅ 37.53290 37.52150
mc2 mc2 2021-06-07_default.sh unknown ❌ 121.35900 121.31900
Par4 Par4-wrapped-sq_default unsat ✅ 22.54820 88.02000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.09000 1253.40000
veriT veriT_default unsat ✅ 16.06700 16.06540
Z3 z3-4.8.11_default unsat ✅ 27.75700 27.75600
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 27.95170 27.95140
MathSAT MathSAT-5.6.8_default unsat ✅ 29.54430 29.54000
veriT veriT_default unsat ✅ 13.09930 13.09860
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 34.25930 34.25680
Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 34.20380 34.20520
Z3 z3-4.8.17_default unsat ✅ 34.07880 34.07950
SMT-COMP 2024 0.20 (4/5) cvc5 cvc5 unsat ✅ 24.00712 23.90610
OpenSMT OpenSMT unsat ✅ 3.11147 3.00416
SMTInterpol SMTInterpol unknown ❌ 1202.24712 1320.48629
Yices2 Yices2 unsat ✅ 19.53275 19.43262
Z3alpha Z3-alpha unsat ✅ 20.25728 20.15142
SMT-COMP 2025 0.17 (5/6) cvc5 cvc5 unsat ✅ 24.24413 24.11205
OpenSMT OpenSMT unsat ✅ 4.73048 4.60794
SMTInterpol SMTInterpol unknown ❌ 1201.58772 1414.43458
Yices2 Yices2 unsat ✅ 24.31358 24.19295
Z3alpha Z3-alpha unsat ✅ 92.69110 369.31356
Z3 Z3-alpha-base unsat ✅ 66.36456 66.23796