Performance Tuning RocksDB for Kafka Streams' State Stores

相关文章推荐

叛逆的马克杯 · Freaks-歌詞-Timmy ...· 2 周前 ·

性感的鞭炮 · 2023年– 澳門特別行政區政府入口網站· 11 月前 ·

玩命的拖把 · Mac OS X Lion 即日起在Mac ...· 1 年前 ·

自信的凳子 · 博罗东江本地话绝不是客家话！！！这个概念一定 ...· 1 年前 ·

深情的绿茶 · iPhone 的『 Siri ...· 1 年前 ·

</noscript><div id="___gatsby"><div style="outline:none" tabindex="-1" id="gatsby-focus-wrapper"><div><div class="" style="padding-top:40px"><div class="style-module--topBanner--Hwyod"><div class="style-module--container--a3fug"><div class="style-module--text--1RIO3"><p>How DISH Scaled Their Data Streaming Platform and Data Mesh to Support 5G | <a href="/fr-fr/resources/online-talk/intelligent-5g-network-dish/?utm_campaign=tm.campaigns_cd.land-q3&amp;utm_source=io&amp;utm_medium=banner">Register Now</a></p></div><div class="style-module--phone--X10Sr"><p><a href="https://confluent.cloud/login">S'identifier</a> <a href="/fr-fr/contact">Nous contacter</a></p></div></div></div><i class="cfHeaderNav-style-module--scrollIndicator--8BqQm"/><header class="cfHeaderNav-style-module--header--W7sUL cfHeaderNav-style-module--topPage--xqZ9v top-page cfHeaderNav-style-module--noPageBg--9B1pi"><div class="cfHeaderNav-style-module--container--Im57Z"><a class="cfHeaderNav-style-module--logo--vU0Hb" title="Confluent" data-test-id="link" href="/fr-fr/"><svg class="style-module--logo--Bh1WP" width="212" height="41" viewbox="0 0 212 41"><g fill="#0074A1" fill-rule="evenodd"><path d="M62.065 22.19H64c-.755 3.472-3.705 5.81-7.646 5.81C51.728 28 48 24.55 48 19.989 48 15.427 51.728 12 56.354 12c3.94 0 6.89 2.315 7.646 5.787h-1.935c-.661-2.519-2.785-4.107-5.71-4.107-3.635 0-6.467 2.7-6.467 6.309 0 3.608 2.832 6.332 6.466 6.332 2.926 0 5.05-1.635 5.71-4.131M84 20c0 4.455-3.57 8-8 8s-8-3.545-8-8 3.57-8 8-8 8 3.545 8 8m-1.808 0c0-3.5-2.711-6.318-6.192-6.318-3.48 0-6.192 2.818-6.192 6.318 0 3.5 2.712 6.318 6.192 6.318S82.192 23.5 82.192 20M103 12v16h-1.48l-9.75-12.612V28H90V12h1.435l9.794 12.777V12zM111.86 13.718V19.6h8.15v1.717h-8.15V28H110V12h11v1.718zM138 26.282V28h-11V12h1.914v14.282zM155 20.994c0 4.185-2.79 7.006-7 7.006s-7-2.82-7-7.006V12h1.9v8.994c0 3.075 2.02 5.295 5.1 5.295 3.055 0 5.1-2.22 5.1-5.295V12h1.9v8.994zM163.826 13.718V19.2h8.25v1.718h-8.25v5.365H173V28h-11V12h11v1.718zM191 12v16h-1.48l-9.75-12.612V28H178V12h1.435l9.794 12.777V12zM210 13.718h-5.626V28h-1.77V13.718H197V12h13zM26.375 20.975c.875-.047 1.75-.075 2.625-.139v-.672c-.875-.064-1.75-.092-2.625-.14l-2.625-.081c-1.54-.047-3.08-.06-4.622-.07-.003-1.54-.01-3.082-.051-4.623l-.074-2.625c-.045-.875-.07-1.75-.132-2.625h-.742c-.062.875-.087 1.75-.132 2.625l-.073 2.625c-.02.723-.029 1.447-.036 2.17-.285-.665-.57-1.33-.865-1.991l-1.072-2.397c-.377-.79-.735-1.59-1.127-2.375l-.684.285c.277.831.589 1.65.882 2.475l.937 2.454c.258.675.526 1.346.796 2.018a129.517 129.517 0 0 0-1.56-1.509l-1.908-1.804c-.65-.587-1.287-1.188-1.95-1.763l-.523.524c.574.663 1.175 1.3 1.762 1.95l1.804 1.908c.498.525 1.003 1.043 1.509 1.56-.672-.27-1.343-.538-2.019-.796l-2.453-.937c-.825-.293-1.644-.605-2.476-.883l-.284.685c.785.392 1.584.75 2.375 1.127l2.397 1.072c.66.295 1.325.58 1.99.864-.723.008-1.446.017-2.17.036l-2.624.074c-.875.045-1.75.07-2.625.132v.742c.875.062 1.75.087 2.625.132l2.625.073c1.542.042 3.083.049 4.624.052.01 1.54.022 3.081.069 4.622l.082 2.625c.047.875.075 1.75.139 2.625h.672c.064-.875.092-1.75.14-2.625l.081-2.625c.023-.741.035-1.482.046-2.223.292.681.587 1.361.892 2.037l1.08 2.393c.378.79.738 1.588 1.133 2.373l.62-.259c-.275-.832-.583-1.651-.875-2.478l-.93-2.455c-.262-.694-.534-1.383-.808-2.072.531.517 1.063 1.032 1.604 1.54l1.913 1.799c.652.585 1.29 1.184 1.955 1.758l.476-.476c-.574-.664-1.173-1.303-1.758-1.955l-1.799-1.914a132.32 132.32 0 0 0-1.539-1.603c.688.275 1.377.546 2.07.809l2.457.929c.826.292 1.645.6 2.478.876l.258-.622c-.785-.393-1.582-.755-2.373-1.133l-2.393-1.08c-.676-.304-1.356-.598-2.036-.892.74-.01 1.481-.022 2.222-.045l2.625-.082z"/><path d="M19 37C9.626 37 2 29.374 2 20 2 10.626 9.626 3 19 3c9.374 0 17 7.626 17 17 0 9.374-7.626 17-17 17m0-32.41C10.503 4.59 3.59 11.502 3.59 20S10.503 35.41 19 35.41 34.41 28.497 34.41 20 27.497 4.59 19 4.59"/></g></svg></a><div class="cfHeaderNav-style-module--tests--A3at9 nav-taxonomy-regular"><nav class="cfHeaderNav-style-module--nav--VJst2" data-test-id="top-nav" data-swiftype-index="false"><ul class="cfHeaderNav-style-module--navGroups--z1Jon"><li><a data-test-id="link" href="#">Why Confluent</a><ul class="cfHeaderNav-style-module--navMenu--k5WNE cfHeaderNav-style-module--navSingleColumn--fy88V" data-test-id="Why Confluent-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/apache-kafka-vs-confluent/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Confluent vs. OSS Kafka® </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/cloud-kafka/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Reinventing Kafka </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/streaming-data-pipelines/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Pipelines de données en streaming </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/customers/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Nos clients </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/partners/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Nos partenaires </div></div></a></div></div></div></li></ul></li><li><a data-test-id="link" href="#">Produits</a><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Produits-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navMenuListHeaderContainer--GSHmS"><div><p>Choisir votre déploiement</p></div></div><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/confluent-cloud/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Confluent Cloud </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="/confluent-cloud/pricing">Tarification</a></li> <li><a href="https://confluent.cloud/login" target="_blank">Connexion</a></li> </ul></div></div><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/confluent-platform/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Logiciel : plateforme Confluent </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="/subscription">Abonnement</a></li> </ul></div></div></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/stream-designer/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Stream Designer </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/confluent-connectors/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Connectors </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/ksqldb/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">ksqlDB </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/stream-governance/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Stream Governance </div></div></a></div><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--featureCardContainer_col--9v4X9"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/apache-kafka-vs-confluent/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Confluent ou Kafka : Pourquoi vous avez besoin de Confluent <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/cloud-kafka/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Réinventer Kafka à l'ère du streaming de données <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/streaming-data-pipelines/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Streaming Data Pipelines <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></li><li><a data-test-id="link" href="#">Solutions</a><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Solutions-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navMenuListHeaderContainer--GSHmS"><div><p>Data workloads</p></div></div><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/streaming-data-pipelines/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Streaming Data Pipelines </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="/use-case/database">Database Pipelines</a></li> <li><a href="/use-case/data-warehouse">Data Warehouse Pipelines</a></li> <li><a href="/use-case/mainframe">Mainframe Integration</a></li> </ul></div></div><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/solutions/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Tous les cas d'usage </div></div></a></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navMenuListHeaderContainer--GSHmS"><div><p>Industries</p></div></div><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/financial-services/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Services financiers </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/retail/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Commerce de détail et e-commerce </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/manufacturing/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Industrie </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/government/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Government </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/solutions/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">All Industries </div></div></a></div><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli cfHeaderNav-style-module--featureCardContainer_row--zwlUp"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/ebook/unlock-your-datas-full-potential-with-streaming-data-pipelines/?utm_campaign=tm.campaigns_cd.sdp-solutions-page-nav&amp;utm_medium=page-nav"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Read the Streaming Data Pipelines eBook <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></li><li><a data-test-id="link" href="#">Découvrir</a><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Découvrir-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/blog/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Blog  </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Ressources </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/training/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Formation </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/services/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Services professionnels </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/learn/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Glossaire des Données </div></div></a></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://careers.confluent.io"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Carrières </div></div></a><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://events.confluent.io/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Événements </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="https://events.confluent.io/meetups">Meetups</a></li> <li><a href="https://www.kafka-summit.org" target="_blank">Kafka Summit</a></li> <li><a href="/events/current/">Actualité : événement de streaming de données</a></li> <li><a href="/online-talks">Webinaires</a></li> </ul></div></div></div><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--featureCardContainer_col--9v4X9"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/online-talk/show-me-how-build-streaming-data-pipelines-for-cloud-databases/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Démo de pipelines de données en streaming <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/online-talk/microservices-with-confluent/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Microservices grâce à Confluent <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></li><li><a data-test-id="link" href="#">Développeurs</a><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Développeurs-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://developer.confluent.io/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Développeur Confluent </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://docs.confluent.io/home/overview.html"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Docs </div></div></a></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--featureCardContainer_col--9v4X9"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://developer.confluent.io/quickstart/kafka-on-confluent-cloud"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Mise en route rapide d'Apache Kafka <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://developer.confluent.io/podcast"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Podcast « Streaming audio » <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/community/ask-the-community/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Demander à la communauté <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></li><li class="cfHeaderNav-style-module--navMenuButton--w0Bi2"><a role="button" class="Button-module--button--A-Z1p Button-module--whiteOutline--pRCyA cfHeaderNav-style-module--navButton--jTROj cfHeaderNav-style-module--navExtraButton--q5-km" data-test-id="link" href="/fr-fr/get-started/">Lancez-vous sans frais</a><a role="button" class="Button-module--button--A-Z1p Button-module--island--2yOxk cfHeaderNav-style-module--navButton--jTROj" data-test-id="link" href="/fr-fr/get-started/">Lancez-vous sans frais</a></li><li class="cfHeaderNav-style-module--navMenuButton--w0Bi2"><a class="cfHeaderNav-style-module--navSearchBtn--TBO9l" data-cy="search-icon-test" data-test-id="link" href="#"><svg class="cfHeaderNav-style-module--searchBarIcon--ZSA0y" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="search" role="img" viewbox="0 0 512 512"><path fill="currentColor" d="M505 442.7L405.3 343c-4.5-4.5-10.6-7-17-7H372c27.6-35.3 44-79.7 44-128C416 93.1 322.9 0 208 0S0 93.1 0 208s93.1 208 208 208c48.3 0 92.7-16.4 128-44v16.3c0 6.4 2.5 12.5 7 17l99.7 99.7c9.4 9.4 24.6 9.4 33.9 0l28.3-28.3c9.4-9.4 9.4-24.6.1-34zM208 336c-70.7 0-128-57.2-128-128 0-70.7 57.2-128 128-128 70.7 0 128 57.2 128 128 0 70.7-57.2 128-128 128z"/></svg></a></li><li><div class="cfHeaderNav-style-module--langContainer--Udltb"><button type="button" data-test-id="language" class="Button-module--button--A-Z1p cfHeaderNav-style-module--langButton--PaFDW"><span class="cfHeaderNav-style-module--langDisplay--eX6oE">Français</span><span class="cfHeaderNav-style-module--langIcon---oBIt cfHeaderNav-style-module--langIconLight--WRy6O"/></button></div></li></ul></nav><div class="cfHeaderNav-style-module--navMobileContainer--JQ7I7"><div class="cfHeaderNav-style-module--downloadMobileTop--9LArF"><a role="button" class="Button-module--button--A-Z1p Button-module--whiteOutline--pRCyA cfHeaderNav-style-module--navButton--jTROj cfHeaderNav-style-module--navExtraButton--q5-km" data-test-id="link" href="/fr-fr/get-started/">Lancez-vous sans frais</a><a role="button" class="Button-module--button--A-Z1p Button-module--island--2yOxk cfHeaderNav-style-module--navButton--jTROj" data-test-id="link" href="/fr-fr/get-started/">Lancez-vous sans frais</a></div><button type="button" data-test-id="hamburger-icon" class="Button-module--button--A-Z1p cfHeaderNav-style-module--navMobileHamburgerBtn--m+G-0"><div class="IconHamburger-module--navHamburgerIcon--V6BqV"><span class="IconHamburger-module--line--ZctW0"/><span class="IconHamburger-module--line--ZctW0"/><span class="IconHamburger-module--line--ZctW0"/><span class="IconHamburger-module--line--ZctW0"/></div></button><nav data-test-id="nav-mobile" class="cfHeaderNav-style-module--navMobile--Nf5Pk" style="margin-top:0"><ul class="cfHeaderNav-style-module--navGroups--z1Jon"><li><div class="cfHeaderNav-style-module--downloadMobileBottom--ZrM67"><a role="button" class="Button-module--button--A-Z1p Button-module--denimOutline--rAT-x cfHeaderNav-style-module--navButton--jTROj cfHeaderNav-style-module--navExtraButton--q5-km" data-test-id="link" href="/fr-fr/get-started/">Lancez-vous sans frais</a><a role="button" class="Button-module--button--A-Z1p Button-module--island--2yOxk cfHeaderNav-style-module--navButton--jTROj" data-test-id="link" href="/fr-fr/get-started/">Lancez-vous sans frais</a></div></li><li class="cfHeaderNav-style-module--searchBarContainer--rIMqB" data-test-id="nav-mobile-search"><div class="cfHeaderNav-style-module--searchBar--nFyId"><div class="cfHeaderNav-style-module--searchFormContainer--kGR2q"><form role="search"><svg class="cfHeaderNav-style-module--searchBarIcon--ZSA0y" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="search" role="img" viewbox="0 0 512 512"><path fill="currentColor" d="M505 442.7L405.3 343c-4.5-4.5-10.6-7-17-7H372c27.6-35.3 44-79.7 44-128C416 93.1 322.9 0 208 0S0 93.1 0 208s93.1 208 208 208c48.3 0 92.7-16.4 128-44v16.3c0 6.4 2.5 12.5 7 17l99.7 99.7c9.4 9.4 24.6 9.4 33.9 0l28.3-28.3c9.4-9.4 9.4-24.6.1-34zM208 336c-70.7 0-128-57.2-128-128 0-70.7 57.2-128 128-128 70.7 0 128 57.2 128 128 0 70.7-57.2 128-128 128z"/></svg><input type="search" placeholder="Search" autocomplete="off" autocorrect="off" autocapitalize="off" name="s" value="" class="style-module--input--fZLFL st-default-search-input" id="nav-search-input"/><svg class="cfHeaderNav-style-module--inputBarResetIcon--JFpIe" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="times" role="img" viewbox="0 0 352 512"><path fill="currentColor" d="M242.72 256l100.07-100.07c12.28-12.28 12.28-32.19 0-44.48l-22.24-22.24c-12.28-12.28-32.19-12.28-44.48 0L176 189.28 75.93 89.21c-12.28-12.28-32.19-12.28-44.48 0L9.21 111.45c-12.28 12.28-12.28 32.19 0 44.48L109.28 256 9.21 356.07c-12.28 12.28-12.28 32.19 0 44.48l22.24 22.24c12.28 12.28 32.2 12.28 44.48 0L176 322.72l100.07 100.07c12.28 12.28 32.2 12.28 44.48 0l22.24-22.24c12.28-12.28 12.28-32.19 0-44.48L242.72 256z"/></svg></form></div></div></li><li data-test-id="Why Confluent-mobile"><div class="cfHeaderNav-style-module--navMobileMenuTile--BB861"><span data-test-id="nav-mobile-label">Why Confluent</span><button type="button" class="Button-module--button--A-Z1p"><svg class="cfHeaderNav-style-module--arrows--OSgyE" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="angle-down" role="img" viewbox="0 0 320 512"><path fill="currentColor" d="M143 352.3L7 216.3c-9.4-9.4-9.4-24.6 0-33.9l22.6-22.6c9.4-9.4 24.6-9.4 33.9 0l96.4 96.4 96.4-96.4c9.4-9.4 24.6-9.4 33.9 0l22.6 22.6c9.4 9.4 9.4 24.6 0 33.9l-136 136c-9.2 9.4-24.4 9.4-33.8 0z"/></svg></button></div><div class="cfHeaderNav-style-module--navMenuContainer--Le3Gx"><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Why Confluent-mobile-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/apache-kafka-vs-confluent/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Confluent vs. OSS Kafka® </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/cloud-kafka/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Reinventing Kafka </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/streaming-data-pipelines/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Pipelines de données en streaming </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/customers/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Nos clients </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/partners/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Nos partenaires </div></div></a></div></div></div></li></ul></div></li><li data-test-id="Produits-mobile"><div class="cfHeaderNav-style-module--navMobileMenuTile--BB861"><span data-test-id="nav-mobile-label">Produits</span><button type="button" class="Button-module--button--A-Z1p"><svg class="cfHeaderNav-style-module--arrows--OSgyE" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="angle-down" role="img" viewbox="0 0 320 512"><path fill="currentColor" d="M143 352.3L7 216.3c-9.4-9.4-9.4-24.6 0-33.9l22.6-22.6c9.4-9.4 24.6-9.4 33.9 0l96.4 96.4 96.4-96.4c9.4-9.4 24.6-9.4 33.9 0l22.6 22.6c9.4 9.4 9.4 24.6 0 33.9l-136 136c-9.2 9.4-24.4 9.4-33.8 0z"/></svg></button></div><div class="cfHeaderNav-style-module--navMenuContainer--Le3Gx"><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Produits-mobile-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navMenuListHeaderContainer--GSHmS"><div><p>Choisir votre déploiement</p></div></div><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/confluent-cloud/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Confluent Cloud </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="/confluent-cloud/pricing">Tarification</a></li> <li><a href="https://confluent.cloud/login" target="_blank">Connexion</a></li> </ul></div></div><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/confluent-platform/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Logiciel : plateforme Confluent </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="/subscription">Abonnement</a></li> </ul></div></div></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/stream-designer/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Stream Designer </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/confluent-connectors/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Connectors </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/ksqldb/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">ksqlDB </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/product/stream-governance/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Stream Governance </div></div></a></div><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--featureCardContainer_col--9v4X9"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/apache-kafka-vs-confluent/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Confluent ou Kafka : Pourquoi vous avez besoin de Confluent <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/cloud-kafka/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Réinventer Kafka à l'ère du streaming de données <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/streaming-data-pipelines/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Streaming Data Pipelines <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></div></li><li data-test-id="Solutions-mobile"><div class="cfHeaderNav-style-module--navMobileMenuTile--BB861"><span data-test-id="nav-mobile-label">Solutions</span><button type="button" class="Button-module--button--A-Z1p"><svg class="cfHeaderNav-style-module--arrows--OSgyE" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="angle-down" role="img" viewbox="0 0 320 512"><path fill="currentColor" d="M143 352.3L7 216.3c-9.4-9.4-9.4-24.6 0-33.9l22.6-22.6c9.4-9.4 24.6-9.4 33.9 0l96.4 96.4 96.4-96.4c9.4-9.4 24.6-9.4 33.9 0l22.6 22.6c9.4 9.4 9.4 24.6 0 33.9l-136 136c-9.2 9.4-24.4 9.4-33.8 0z"/></svg></button></div><div class="cfHeaderNav-style-module--navMenuContainer--Le3Gx"><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Solutions-mobile-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navMenuListHeaderContainer--GSHmS"><div><p>Data workloads</p></div></div><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/streaming-data-pipelines/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Streaming Data Pipelines </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="/use-case/database">Database Pipelines</a></li> <li><a href="/use-case/data-warehouse">Data Warehouse Pipelines</a></li> <li><a href="/use-case/mainframe">Mainframe Integration</a></li> </ul></div></div><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/solutions/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Tous les cas d'usage </div></div></a></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U cfHeaderNav-style-module--hasSubHeader--1+Wli"><div class="cfHeaderNav-style-module--navMenuListHeaderContainer--GSHmS"><div><p>Industries</p></div></div><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/financial-services/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Services financiers </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/retail/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Commerce de détail et e-commerce </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/manufacturing/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Industrie </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/industry-solutions/government/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Government </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/solutions/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">All Industries </div></div></a></div><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--hasSubHeader--1+Wli cfHeaderNav-style-module--featureCardContainer_row--zwlUp"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/ebook/unlock-your-datas-full-potential-with-streaming-data-pipelines/?utm_campaign=tm.campaigns_cd.sdp-solutions-page-nav&amp;utm_medium=page-nav"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Read the Streaming Data Pipelines eBook <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></div></li><li data-test-id="Découvrir-mobile"><div class="cfHeaderNav-style-module--navMobileMenuTile--BB861"><span data-test-id="nav-mobile-label">Découvrir</span><button type="button" class="Button-module--button--A-Z1p"><svg class="cfHeaderNav-style-module--arrows--OSgyE" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="angle-down" role="img" viewbox="0 0 320 512"><path fill="currentColor" d="M143 352.3L7 216.3c-9.4-9.4-9.4-24.6 0-33.9l22.6-22.6c9.4-9.4 24.6-9.4 33.9 0l96.4 96.4 96.4-96.4c9.4-9.4 24.6-9.4 33.9 0l22.6 22.6c9.4 9.4 9.4 24.6 0 33.9l-136 136c-9.2 9.4-24.4 9.4-33.8 0z"/></svg></button></div><div class="cfHeaderNav-style-module--navMenuContainer--Le3Gx"><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Découvrir-mobile-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/blog/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Blog  </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Ressources </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/training/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Formation </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/services/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Services professionnels </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/learn/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Glossaire des Données </div></div></a></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://careers.confluent.io"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Carrières </div></div></a><div class="cfHeaderNav-style-module--navItemCardContainer--Rl5jc"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://events.confluent.io/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Événements </div></div></a><div class="cfHeaderNav-style-module--navItemSubMenuContainer--PZSzi"><ul> <li><a href="https://events.confluent.io/meetups">Meetups</a></li> <li><a href="https://www.kafka-summit.org" target="_blank">Kafka Summit</a></li> <li><a href="/events/current/">Actualité : événement de streaming de données</a></li> <li><a href="/online-talks">Webinaires</a></li> </ul></div></div></div><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--featureCardContainer_col--9v4X9"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/online-talk/show-me-how-build-streaming-data-pipelines-for-cloud-databases/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Démo de pipelines de données en streaming <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/resources/online-talk/microservices-with-confluent/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Microservices grâce à Confluent <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></div></li><li data-test-id="Développeurs-mobile"><div class="cfHeaderNav-style-module--navMobileMenuTile--BB861"><span data-test-id="nav-mobile-label">Développeurs</span><button type="button" class="Button-module--button--A-Z1p"><svg class="cfHeaderNav-style-module--arrows--OSgyE" aria-hidden="true" width="18px" height="18px" focusable="false" data-prefix="fas" data-icon="angle-down" role="img" viewbox="0 0 320 512"><path fill="currentColor" d="M143 352.3L7 216.3c-9.4-9.4-9.4-24.6 0-33.9l22.6-22.6c9.4-9.4 24.6-9.4 33.9 0l96.4 96.4 96.4-96.4c9.4-9.4 24.6-9.4 33.9 0l22.6 22.6c9.4 9.4 9.4 24.6 0 33.9l-136 136c-9.2 9.4-24.4 9.4-33.8 0z"/></svg></button></div><div class="cfHeaderNav-style-module--navMenuContainer--Le3Gx"><ul class="cfHeaderNav-style-module--navMenu--k5WNE" data-test-id="Développeurs-mobile-dropdown"><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://developer.confluent.io/"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Développeur Confluent </div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://docs.confluent.io/home/overview.html"><div class="cfHeaderNav-style-module--titleContainer--f8vw9"><div class="cfHeaderNav-style-module--navItemCardIconContainer--LRV1U"><span class=""/></div><div class="cfHeaderNav-style-module--title--BveWy">Docs </div></div></a></div></div></div></li><li><div class="cfHeaderNav-style-module--navMenuListContainer--qtqoV cfHeaderNav-style-module--navMenuFeatureContainer--YIi0U"><div class="cfHeaderNav-style-module--subMenuContainer--a1PaR"><div class="cfHeaderNav-style-module--itemCardContainer--okOhi cfHeaderNav-style-module--featureCardContainer_col--9v4X9"><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://developer.confluent.io/quickstart/kafka-on-confluent-cloud"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Mise en route rapide d'Apache Kafka <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" rel="noopener" target="_blank" href="https://developer.confluent.io/podcast"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Podcast « Streaming audio » <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a><a class="cfHeaderNav-style-module--navItemCard--huac5" data-test-id="link" href="/fr-fr/community/ask-the-community/"><div class="cfHeaderNav-style-module--navItemCardImageContainer--XhJ8Q"><span class=""/></div><div class="cfHeaderNav-style-module--titleContainer--f8vw9 cfHeaderNav-style-module--featureTitleContainer--L1XsG"><div class="cfHeaderNav-style-module--title--BveWy">Demander à la communauté <svg class="cfHeaderNav-style-module--titleIcon--J0xOS" aria-hidden="true" width="16px" height="16px" focusable="false" data-prefix="fas" data-icon="arrow-right" role="img" viewbox="0 0 448 512"><path fill="currentColor" d="M190.5 66.9l22.2-22.2c9.4-9.4 24.6-9.4 33.9 0L441 239c9.4 9.4 9.4 24.6 0 33.9L246.6 467.3c-9.4 9.4-24.6 9.4-33.9 0l-22.2-22.2c-9.5-9.5-9.3-25 .4-34.3L311.4 296H24c-13.3 0-24-10.7-24-24v-32c0-13.3 10.7-24 24-24h287.4L190.9 101.2c-9.8-9.3-10-24.8-.4-34.3z"/></svg></div></div></a></div></div></div></li></ul></div></li><li><div class="cfHeaderNav-style-module--navAdContainer--ZIvJ7"><a data-test-id="link" rel="noopener noreferrer" target="_blank" href="https://2022.currentevent.io/ereg/newreg.php?eventid=678796&amp;language=eng"><span class=""/></a></div></li></ul></nav></div></div></div></header><section id="filters" class="style-module--sectionContent--ZxTYc style-module--blogMainSection--vBiHR" style="background:none"><div class="style-module--contentContainer--9MAR3 style-module--noBackground--j6odi style-module--sectionContentContainer--kBACc"><div class="style-module--mainContent--qKSSf"><div class="style-module--contentContainer--W5YKB"><header><time class="Time-module--times--OAvGC style-module--mobileTimes--i8Wye"><span>Mar 10, 2021</span><span class="Time-module--readTime--ZFBdG">Temps de lecture: 20 min</span></time><div class="style-module--titleContainer--jtZSM"><h1>How to Tune RocksDB for Your Kafka Streams Application</h1></div><div class="style-module--blogInfo--c7K35"><nav class="style-module--breadcrumbs--1B3YW style-module--breadcrumb--Bcgvi"><ol class="style-module--list--+rHlc"><li class="style-module--listItem--rkH4q style-module--caret--jcg-8"><a data-test-id="link" href="/fr-fr/blog/area/technology/">Technology</a></li><li class="style-module--listItem--rkH4q style-module--caret--jcg-8"><a data-test-id="link" href="/fr-fr/blog/area/technology/?categories=use-cases">Use Cases</a></li></ol></nav><div class="style-module--sideContent--qFOpo style-module--headerContent--pObwe"><div class="style-module--sideBannerContainer--pcGvO"><div class="style-module--card--aAv+U CfCard-module--card--67iOk style-module--templateBanners--8GRm4" data-test-id="card"><div class="style-module--content--U4Vt7"><div class="style-module--main--QrvVO"><h3 class="style-module--title--5vePl"><div>Get started with Confluent, for free</div></h3><div class="ButtonGroup-module--buttonGroup--Tt3IG ButtonGroup-module--left--zuFew ButtonGroup-module--singleCta--SibkB style-module--ctaContainer--nUYf1" role="group"><a role="button" text="Get started" url="/get-started/" class="Button-module--button--A-Z1p Button-module--denim--GMRbD ButtonGroup-module--button--9mpKj" data-test-id="link" href="/fr-fr/get-started/">Get started</a></div></div></div></div><div class="style-module--card--aAv+U CfCard-module--card--67iOk style-module--templateBanners--8GRm4" data-test-id="card"><div class="style-module--content--U4Vt7"><div class="style-module--main--QrvVO"><h3 class="style-module--title--5vePl"><div>Watch demo: Kafka streaming in 10 minutes</div></h3><div class="ButtonGroup-module--buttonGroup--Tt3IG ButtonGroup-module--left--zuFew ButtonGroup-module--singleCta--SibkB style-module--ctaContainer--nUYf1" role="group"><a role="button" text="Watch now" url="/online-talks/confluent-cloud-demo/" class="Button-module--button--A-Z1p Button-module--denim--GMRbD ButtonGroup-module--button--9mpKj" data-test-id="link" href="/fr-fr/online-talks/confluent-cloud-demo/">Watch now</a></div></div></div></div></div><section class="style-module--sectionContent--ZxTYc SharePostSection-module--sharePostSection---Ntyp style-module--sidebarSharePostSection--3X1a6" style="background:none"><div class="style-module--contentContainer--9MAR3 style-module--noBackground--j6odi style-module--contentClassName--u+ARV"><div class="SharePostSection-module--shareContainer--4fS8c style-module--sidebarSharePost--w7KTR"><button aria-label="twitter" class="react-share__ShareButton IconShare-module--button--0awKi SharePostSection-module--shareIcon--II1xM" style="background-color:transparent;border:none;padding:0;font:inherit;color:inherit;cursor:pointer"><svg viewbox="0 0 64 64" width="36" height="36"><circle cx="32" cy="32" r="31" fill="#00aced"/><path d="M48,22.1c-1.2,0.5-2.4,0.9-3.8,1c1.4-0.8,2.4-2.1,2.9-3.6c-1.3,0.8-2.7,1.3-4.2,1.6 C41.7,19.8,40,19,38.2,19c-3.6,0-6.6,2.9-6.6,6.6c0,0.5,0.1,1,0.2,1.5c-5.5-0.3-10.3-2.9-13.5-6.9c-0.6,1-0.9,2.1-0.9,3.3 c0,2.3,1.2,4.3,2.9,5.5c-1.1,0-2.1-0.3-3-0.8c0,0,0,0.1,0,0.1c0,3.2,2.3,5.8,5.3,6.4c-0.6,0.1-1.1,0.2-1.7,0.2c-0.4,0-0.8,0-1.2-0.1 c0.8,2.6,3.3,4.5,6.1,4.6c-2.2,1.8-5.1,2.8-8.2,2.8c-0.5,0-1.1,0-1.6-0.1c2.9,1.9,6.4,2.9,10.1,2.9c12.1,0,18.7-10,18.7-18.7 c0-0.3,0-0.6,0-0.8C46,24.5,47.1,23.4,48,22.1z" fill="white"/></svg></button><button aria-label="facebook" class="react-share__ShareButton IconShare-module--button--0awKi SharePostSection-module--shareIcon--II1xM" style="background-color:transparent;border:none;padding:0;font:inherit;color:inherit;cursor:pointer"><svg viewbox="0 0 64 64" width="36" height="36"><circle cx="32" cy="32" r="31" fill="#3b5998"/><path d="M34.1,47V33.3h4.6l0.7-5.3h-5.3v-3.4c0-1.5,0.4-2.6,2.6-2.6l2.8,0v-4.8c-0.5-0.1-2.2-0.2-4.1-0.2 c-4.1,0-6.9,2.5-6.9,7V28H24v5.3h4.6V47H34.1z" fill="white"/></svg></button><button aria-label="linkedin" class="react-share__ShareButton IconShare-module--button--0awKi SharePostSection-module--shareIcon--II1xM" style="background-color:transparent;border:none;padding:0;font:inherit;color:inherit;cursor:pointer"><svg viewbox="0 0 64 64" width="36" height="36"><circle cx="32" cy="32" r="31" fill="#007fb1"/><path d="M20.4,44h5.4V26.6h-5.4V44z M23.1,18c-1.7,0-3.1,1.4-3.1,3.1c0,1.7,1.4,3.1,3.1,3.1 c1.7,0,3.1-1.4,3.1-3.1C26.2,19.4,24.8,18,23.1,18z M39.5,26.2c-2.6,0-4.4,1.4-5.1,2.8h-0.1v-2.4h-5.2V44h5.4v-8.6 c0-2.3,0.4-4.5,3.2-4.5c2.8,0,2.8,2.6,2.8,4.6V44H46v-9.5C46,29.8,45,26.2,39.5,26.2z" fill="white"/></svg></button><button aria-label="reddit" class="react-share__ShareButton IconShare-module--button--0awKi SharePostSection-module--shareIcon--II1xM" style="background-color:transparent;border:none;padding:0;font:inherit;color:inherit;cursor:pointer"><svg viewbox="0 0 64 64" width="36" height="36"><circle cx="32" cy="32" r="31" fill="#ff4500"/><path d="m 52.8165,31.942362 c 0,-2.4803 -2.0264,-4.4965 -4.5169,-4.4965 -1.2155,0 -2.3171,0.4862 -3.128,1.2682 -3.077,-2.0247 -7.2403,-3.3133 -11.8507,-3.4782 l 2.5211,-7.9373 6.8272,1.5997 -0.0102,0.0986 c 0,2.0281 1.6575,3.6771 3.6958,3.6771 2.0366,0 3.6924,-1.649 3.6924,-3.6771 0,-2.0281 -1.6575,-3.6788 -3.6924,-3.6788 -1.564,0 -2.8968,0.9758 -3.4357,2.3443 l -7.3593,-1.7255 c -0.3213,-0.0782 -0.6477,0.1071 -0.748,0.4233 L 32,25.212062 c -4.8246,0.0578 -9.1953,1.3566 -12.41,3.4425 -0.8058,-0.7446 -1.8751,-1.2104 -3.0583,-1.2104 -2.4905,0 -4.5152,2.0179 -4.5152,4.4982 0,1.649 0.9061,3.0787 2.2389,3.8607 -0.0884,0.4794 -0.1462,0.9639 -0.1462,1.4569 0,6.6487 8.1736,12.0581 18.2223,12.0581 10.0487,0 18.224,-5.4094 18.224,-12.0581 0,-0.4658 -0.0493,-0.9248 -0.1275,-1.377 1.4144,-0.7599 2.3885,-2.2304 2.3885,-3.9406 z m -29.2808,3.0872 c 0,-1.4756 1.207,-2.6775 2.6894,-2.6775 1.4824,0 2.6877,1.2019 2.6877,2.6775 0,1.4756 -1.2053,2.6758 -2.6877,2.6758 -1.4824,0 -2.6894,-1.2002 -2.6894,-2.6758 z m 15.4037,7.9373 c -1.3549,1.3481 -3.4816,2.0043 -6.5008,2.0043 l -0.0221,-0.0051 -0.0221,0.0051 c -3.0209,0 -5.1476,-0.6562 -6.5008,-2.0043 -0.2465,-0.2448 -0.2465,-0.6443 0,-0.8891 0.2465,-0.2465 0.6477,-0.2465 0.8942,0 1.105,1.0999 2.9393,1.6337 5.6066,1.6337 l 0.0221,0.0051 0.0221,-0.0051 c 2.6673,0 4.5016,-0.5355 5.6066,-1.6354 0.2465,-0.2465 0.6477,-0.2448 0.8942,0 0.2465,0.2465 0.2465,0.6443 0,0.8908 z m -0.3213,-5.2615 c -1.4824,0 -2.6877,-1.2002 -2.6877,-2.6758 0,-1.4756 1.2053,-2.6775 2.6877,-2.6775 1.4824,0 2.6877,1.2019 2.6877,2.6775 0,1.4756 -1.2053,2.6758 -2.6877,2.6758 z" fill="white"/></svg></button></div></div></section><div class="style-module--authorContainer--5HOX8"><h6>Écrit par</h6><ul class="Authors-module--authors--AmqIh Authors-module--row--s5VVu style-module--authors--fw+RZ"><li class="Authors-module--author--kCDCj style-module--authorsList--u6UmT style-module--col_2--oSILK" itemtype="http://microformats.org/profile/hcard"><a data-test-id="link" href="/fr-fr/blog/author/bruno-cadonna/"><span class=""/></a><div class="Authors-module--authorInfoContainer--fSqR3"><a class="Authors-module--authorName--M4fgw style-module--authorCta--S8+U2" title="View all posts by Bruno Cadonna" data-test-id="link" href="/fr-fr/blog/author/bruno-cadonna/">Bruno Cadonna</a></div></li><li class="Authors-module--author--kCDCj style-module--authorsList--u6UmT style-module--col_2--oSILK" itemtype="http://microformats.org/profile/hcard"><a data-test-id="link" href="/fr-fr/blog/author/dhruba-borthakur/"><span class=""/></a><div class="Authors-module--authorInfoContainer--fSqR3"><a class="Authors-module--authorName--M4fgw style-module--authorCta--S8+U2" title="View all posts by Dhruba Borthakur" data-test-id="link" href="/fr-fr/blog/author/dhruba-borthakur/">Dhruba Borthakur</a></div></li></ul></div></div><time class="Time-module--times--OAvGC style-module--times--SRLov"><span>Mar 10, 2021</span><span class="Time-module--readTime--ZFBdG">Temps de lecture: 20 min</span></time></div></header><div class="style-module--blogContent--aB6es"><div class="style-module--legacyContent--6g-3b" data-swiftype-name="body" data-swiftype-type="text"><p><a href="https://kafka.apache.org/documentation/streams/" target="_blank" rel="noopener">Apache Kafka ships with Kafka Streams</a>, a powerful yet lightweight client library for Java and Scala to implement highly scalable and elastic applications and microservices that process and analyze data stored in Kafka. A Kafka Streams application can perform stateless operations like maps and filters as well as stateful operations like windowed joins and aggregations on incoming data records.</p> <p>For stateful operations, Kafka Streams uses local state stores that are made fault-tolerant by associated changelog topics stored in Kafka. For these state stores, Kafka Streams uses RocksDB as its default storage to maintain local state on a computing node (think: a container that runs one instance of your distributed application). RocksDB is a highly adaptable, embeddable, and persistent key-value store that was originally built by the Engineering team at Facebook. Many companies use RocksDB in their infrastructure to get high performance to serve data. Kafka Streams configures RocksDB to deliver a write-optimized state store.</p> <p>This blog post will cover key concepts that show how Kafka Streams uses RocksDB to maintain its state and how you can tune RocksDB for Kafka Streams’ state stores. We’ll first explain the basics around Kafka Streams and how it uses state stores. Then, we‘ll provide an overview about RocksDB, including the two most used compaction styles, level compaction and universal compaction. Once we understand the foundational principles, we’ll deep dive into operational issues that you may encounter when you operate your Kafka Streams application with RocksDB state stores, and most importantly how you can tune RocksDB to overcome those issues.</p> <h2 id="kafka-streams"><a id="kafka-streams"/>Kafka Streams basics</h2> <p>Kafka Streams defines its computational logic through a so-called topology. A topology consists of processors connected by streams. A processor executes its logic on a stream record by record.</p> <p>Processors can be <em>stateless</em> or <em>stateful</em>. Stateless processors process records independently of any other data. For example, a processor that implements a map operation (such as masking all but the last four digits of a credit card number) transforms a record into another record without querying any other data. Stateful processors query and maintain a state during the processing of records. For example, an aggregation operation (such as counting the number of input records received in the past five minutes) needs to retrieve the current aggregated value from the state store, update the current aggregated value with the input record, and finally write the new aggregated value to the state store as well as forward the new aggregated value to the downstream processors in the topology. Note that Kafka Streams does not consider processors as stateful if their state is exclusively managed outside of Kafka Streams, that is, when user code within the processor directly calls an external database. While managing state outside of Kafka Streams is possible, we usually recommend managing state inside Kafka Streams to benefit from high performance and processing guarantees.</p> <p>The topology in the figure above reads records from a Kafka topic and streams the records through a series of stateless and stateful processors. Each processor applies its logic on the input record and forwards an output record to the downstream processors. The last processor in the topology writes its output records to a Kafka topic.</p> <p>Once a topology is specified, Kafka Streams will execute the topology. Just as a process is an instance of a program that is executed by a computer, a task is an instance of a topology that is executed by Kafka Streams. Kafka Streams creates a task for each partition of the input topic, and each task processes records from its input partition. For example, if the input topic in the topology above has five partitions p<sub>0</sub>—p<sub>4</sub>, Kafka Streams will create five tasks t<sub>0</sub>—t<sub>4</sub>. Task t<sub>0</sub> processes records from partition p<sub>0</sub>, task t<sub>1</sub> processes records from partition p<sub>1</sub>, and so on. To parallelize the processing, Kafka Streams distributes the five tasks, t<sub>0</sub>—t<sub>4</sub>, over all Kafka Streams clients belonging to the same application via the Kafka rebalance protocol.</p> <h2 id="state-store"><a id="state-store"/>State store basics</h2> <p>A stateful processor may use one or more state stores. Each task that contains a stateful processor has exclusive access to the state stores in the processor. That means a topology with two state stores and five input partitions will lead to five tasks, and each task will own two state stores resulting in 10 state stores in total for your Kafka Streams application.</p> <p>Now that we know how Kafka Streams instantiates state stores, let’s have a look into the internals of them. State stores in Kafka Streams are layered in four ways:</p> <li>The outermost layer collects metrics about the operations on the state store and serializes and deserializes the records that are written to and read from the state store.</li> <li>The next layer caches the records. If a record exists in the cache with the same key as a new record, the cache overwrites the existing record with the new record; otherwise, the cache adds a new entry for the new record. The cache is the primary serving area for lookups. If a lookup can’t find a record with a given key in the cache, it is forwarded to the next layer. If this lookup returns an entry, the entry is added to the cache. If the cache exceeds its configured size during a write, the cache evicts the records that have been least recently used and sends new and overwritten records downstream. The caching layer decreases downstream traffic because no updates are sent downstream unless the cache evicts records or is flushed. The cache’s size is configurable. If it is set to zero, the cache is disabled.</li> <li>The changelogging layer sends each record updated in the state store to a topic in Kafka—the state’s changelog topic. The changelog topic is a compacted topic that replicates the data in the local state. Changelogging is needed for fault tolerance, as we will explain below.</li> <li>The innermost layer updates and reads the local state store.</li> <p>Let’s assume a Kafka Streams application consists of three Kafka Streams clients. While the application executes, one of the Kafka Streams clients crashes. The tasks that the crashed client hosted are redistributed among the two remaining clients. The local states of the crashed client need to be restored on the remaining clients before they can resume processing. However, the remaining clients can’t directly access the local state of the crashed client. Luckily, the changelogging layer sent records to the changelog topic to enable the running clients to restore the local state. This restoration mechanism based on the changelog topic is applied whenever a Kafka Streams client needs to update a local state or needs to create a local state from scratch. In other words, the state’s changelog topic is the single source of truth of a state whereas a state store is a local disposable replica of a partition of the state’s changelog topic that allows you to update and query the state with low latency.</p> <p>The restoration of a state store is byte based. During restoration, Kafka Streams writes the records from the changelog topic to the local state store without deserializing them. That means the records bypass all layers above the innermost layer during restoration.</p> <p>The innermost layer of a state store can be any built-in or user-defined state store that implements the state store interface exposed by Kafka Streams. The default state store used in Kafka Streams is RocksDB. Kafka Streams developers initially chose RocksDB because they wanted a write-optimized store. Since RocksDB is the default state store, Kafka Streams provides the means to configure and monitor RocksDB state stores used in a Kafka Streams application.</p> <p>To configure RocksDB, we need to implement the interface <code>RocksDBConfigSetter</code> and pass the class to the Kafka Streams configuration <code>rocksdb.config.setter</code>. An example for a RocksDB configuration is shown below, where the compaction style of RocksDB is set to level compaction instead of universal compaction that is used by default in Kafka Streams.</p> <pre>public static class MyRocksDBConfig implements RocksDBConfigSetter {<br/> @Override<br/> public void setConfig(final String storeName, <br/> final Options options, <br/> final Map&lt;String, Object&gt; configs) {<br/> options.setCompactionStyle(CompactionStyle.LEVEL);<br/> }<br/> <br/> @Override<br/> public void close(final String storeName, final Options options) {}<br/>}</pre> <p>Besides configuring RocksDB, Kafka Streams also exposes <a href="https://docs.confluent.io/platform/current/streams/monitoring.html#rocksdb-metrics" target="_blank" rel="noopener">RocksDB-specific metrics</a> to monitor the RocksDB state stores used in a Kafka Streams application. <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-471%3A+Expose+RocksDB+Metrics+in+Kafka+Streams" target="_blank" rel="noopener">KIP-471</a> and <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-607%3A+Add+Metrics+to+Kafka+Streams+to+Report+Properties+of+RocksDB" target="_blank" rel="noopener">KIP-607</a> introduced RocksDB-specific metrics. The former leverages the statistics that are collected by RocksDB and the latter the properties that are exposed by RocksDB. These metrics provide invaluable support for diagnosing and resolving possible issues with RocksDB state stores when operating a Kafka Streams application.</p> <p>Now that we know the basics of Kafka Streams state stores, we’ll learn how RocksDB works internally and how we can tune it.</p> <h2 id="introduction"><a id="introduction"/>Introduction to RocksDB</h2> <p>As you read earlier, the default state store in Kafka Streams is <a href="https://github.com/facebook/rocksdb" target="_blank" rel="noopener">RocksDB</a>. RocksDB is an embeddable key-value persistent store. It is a C++ and Java library that you can embed into your applications. RocksDB is natively designed to give <a href="https://rockset.com/blog/how-we-use-rocksdb-at-rockset/" target="_blank" rel="noopener">high-end performance</a> for fast storage and server workloads. For example, you can configure RocksDB to provide extremely low query latency on terabytes of data.</p> <p>Unlike other databases, RocksDB is not a distributed system. It is not highly available and does not have a failover scheme. That doesn’t mean you lose your state store data when you store it in RocksDB using Kafka Streams, because it’s Kafka Streams that makes RocksDB fault tolerant by replicating the state store data to a Kafka topic.</p> <p>RocksDB is a storage engine library that implements a key-value interface where keys and values are arbitrary bytes. All data is organized in sorted order by the key. RocksDB offers these following operations: <code>Get(key)</code>, <code>NewIterator()</code>, <code>Put(key, val)</code>, <code>Merge(key, val)</code>, <code>Delete(key)</code>, and <code>SingleDelete(key)</code>. Out of these operations, Kafka Streams specifically calls <code>Get(key)</code>, <code>NewIterator()</code>, <code>Put(key, val)</code>, and <code>Delete(key)</code>.</p> <p>The operations can be organized into these common categories:</p> <li><strong>Updates:</strong> You can update keys via the Put and Delete API. Put inserts a single key-value into the database, and Delete removes a single key-value from the database.</li> <li><strong>Reads:</strong> You can read data via the Get and NewIterator APIs. Get allows an application to fetch a single key-value from the database. An Iterator enables an application to do a RangeScan on the database. The Iterator API can seek to a specified key. Then, the application can start scanning one key at a time from that point, and the keys are returned in sorted order.</li> <li><strong><a href="https://jiaweichiu.github.io/articles/2018-12/rocksdb-merge-operators" target="_blank" rel="noopener">Merges</a>:</strong> You can tell RocksDB how to do incremental updates on existing data by avoiding reads. Most databases store data in a disc or a solid-state drive (SSD). An SSD can support a finite amount of I/Os per second. Let’s say you want to do 1 million updates. You will need to perform 1 million reads and 1 million writes—or in other words, 2 million input/output operations per second (IOPS). With the merge operator, you can avoid reads, thus needing only 1 million IOPS. In short, the merge operator in RocksDB helps save half of your disc usage. You can read more about the <a href="https://github.com/facebook/rocksdb/wiki/Merge-Operator" target="_blank" rel="noopener">merge operator</a> on GitHub.</li> <h3 id="architecture"><a id="architecture"/>RocksDB architecture overview</h3> <p><a href="https://rocksdb.org/" target="_blank" rel="noopener">RocksDB</a> uses the <a href="https://en.wikipedia.org/wiki/Log-structured_merge-tree" target="_blank" rel="noopener">log-structured merge architecture</a> to handle high read and write rates on data. In order to debug production applications when you’re running it in a Kafka Streams environment, it helps to understand the architecture of how reads and writes occur. Let’s deep dive into the RocksDB write path.</p> <p>As a side note for the description below, when a write request comes in, it can go to the transaction log <em>and</em> memtable (<strong>step 1a</strong> and <strong>1b</strong>), or it can just go to the memtable only (<strong>step 1a</strong>). In RocksDB, a transaction log is stored as a <em>log file</em> in storage. You will typically want to use a transaction log if you care about data loss when a database crashes unexpectedly.</p> <p>A memtable is an in-memory structure where data is buffered. In RocksDB, the default implementation of the memtable is a skip list. However, RocksDB supports a pluggable API that allows an application to provide its own implementation of a memtable. When a memtable fills up, it is flushed to a static sorted table (SST) file on storage.</p> <h4 id="step-1a"><a id="step-1a"/>Step 1a</h4> <p>When there is a write request, it writes to an active memtable, also called a write buffer.</p> <h4 id="step-1b"><a id="step-1b"/>Step 1b</h4> <p>A write request can also directly write to a transaction log. Periodically, the transaction log gets truncated when the SST files persist the data. It’s important to note that in Kafka Streams, the changelog topics replicate the local state stores in Kafka, and hence they behave like transaction logs. As a result, Kafka Streams is configured not to use the RocksDB transaction log.</p> <h4 id="step-2"><a id="step-2"/>Step 2</h4> <p>When the memtable is full, it becomes a read-only memtable. From there, new writes continue to accumulate in a new memtable.</p> <h4 id="step-3"><a id="step-3"/>Step 3</h4> <p>As new writes accumulate in the new memtable, the read-only memtables are flushed into SST files on the storage system. The data in a SST file is lexicographically sorted to facilitate easy key lookups and sequential scans.</p> <p>SST files are organized in levels (L0, L1, and so on). Each level has an arbitrary number of SST files. Each SST file has metadata that describes the key range. When you are looking up a particular key, RocksDB checks the metadata to see if a key may exist in a particular file. If it does, it’ll read the file. If it doesn’t, it’ll check the next level. To avoid checking unnecessary files, Bloom filters are used. A <a href="https://en.wikipedia.org/wiki/Bloom_filter" target="_blank" rel="noopener">Bloom filter</a> is a data structure used to test whether an element is a member of a set. There are Bloom bits (a bit array) that RocksDB keeps for every memtable, and there are also Bloom bits that are stored in every SST file. RocksDB checks Bloom bits first to see if a key may exist in a particular memtable or in a particular SST file. If there is no Bloom match, then we can skip reading the file contents. This is how RocksDB saves on random reads on SST files.</p> <h4 id="step-4"><a id="step-4"/>Step 4</h4> <p>This is where periodic <em>compaction</em> occurs. Compaction is a process that lets you maintain the database in reasonable shape and size so that RocksDB performance is maintained. Later on, we’ll <a href="#compaction-styles">cover compaction in more detail</a>.</p> <p>Now that we have a high-level overview of how Bloom filters function in reducing the number of random reads in SST files, let’s deep dive into the RocksDB read path:<img class=" wp-image-29718 aligncenter" src="https://cdn.confluent.io/wp-content/uploads/Untitled-design-1.png" sizes="(max-width: 649px) 100vw, 649px" srcset="https://cdn.confluent.io/wp-content/uploads/Untitled-design-1.png 1999w, https://cdn.confluent.io/wp-content/uploads/Untitled-design-1-300x169.png 300w, https://cdn.confluent.io/wp-content/uploads/Untitled-design-1-1024x577.png 1024w, https://cdn.confluent.io/wp-content/uploads/Untitled-design-1-768x433.png 768w, https://cdn.confluent.io/wp-content/uploads/Untitled-design-1-1536x865.png 1536w, https://cdn.confluent.io/wp-content/uploads/Untitled-design-1-350x197.png 350w, https://cdn.confluent.io/wp-content/uploads/Untitled-design-1-600x338.png 600w" alt="RocksDB read path" width="649" height="366" loading="lazy"/></p> <h4 id="step-one"><a id="step-one"/>Step 1</h4> <p>When we get a read request, the request looks at the active memtable to see if the key is there because a recent write request may have stored the key there. If we find the key in the active memtable, we don’t need to look at the read-only memtable (step 2) or the SST files (step 3).</p> <h4 id="step-two"><a id="step-two"/>Step 2</h4> <p>If the key is not in the active memtable, the request checks the read-only memtable from newest to oldest. It’s important to note that all memtables may have overlapping keys because they contain the most recent datasets that your application writes. If we find the result here, we return it, and we don’t need to look at the SST files (step 3).</p> <h4 id="step-three"><a id="step-three"/>Step 3</h4> <p>If we do not find the key in any of the memtables, then the read request checks all the SST files on disk using Bloom filters and returns the value.</p> <p>Another critical component to highlight in this architecture is the read-only block cache that Kafka Streams uses. It is an in-memory buffer that caches frequently requested keys. It’s important to emphasize that memtables are only used for writes, while the block cache is only used for reads. The memtable and read-only block cache are the two pieces of memory that RocksDB uses to make your database efficient and performant for scaling.</p> <p>We went into detail with RocksDB’s architecture and how writes and reads operate in RocksDB. One thing we didn’t mention is that RocksDB is highly configurable. Let’s highlight a few main configuration options of RocksDB.</p> <li>You can configure the transaction log to be enabled or disabled. Kafka Streams doesn’t use the transaction log in RocksDB because the mentioned changelog topics on the Kafka brokers themselves behave as transaction logs.</li> <li>The memtable is a skip list by default. You can configure the memtable to be a vector memtable instead if you want to load data in bulk.</li> <li>Another component that you can configure in RocksDB is compaction. We haven’t covered compaction in detail, and we will dive into it in the next section.</li> <h2 id="compaction-styles"><a id="compaction-styles"/>Compaction styles in RocksDB</h2> <p>The log structured merge architecture is an append-only data structure. For example, if you delete a key, the deletion is marked and recorded but the key is not immediately removed. Similarly, updates to a key are appended, but the previous value of the key is not updated in place. In order to keep the database size under control, we have to remove all the deleted keys and corresponding delete operations as well as the updated key-value pairs. <a href="https://github.com/facebook/rocksdb/wiki/Compaction" target="_blank" rel="noopener">Compaction</a> is a process of combining a set of SST files and generating new SST files with overwritten keys and deleted keys purged from the output files. Compaction is crucial for <a href="https://rockset.com/blog/how-we-use-rocksdb-at-rockset/" target="_blank" rel="noopener">securing high performance in RocksDB</a>. There are two basic types of compaction that have different characteristics and are used for different workloads: level compaction and universal compaction.</p> <h3 id="level-compaction"><a id="level-compaction"/>Level compaction</h3> <p>In level compaction, there are multiple levels (L1-Ln), where an arbitrary number of SST files exist in each level (the green boxes below). L0 is a unique level that contains files just flushed from the memtable:<br/><img class=" wp-image-29720 aligncenter" src="https://cdn.confluent.io/wp-content/uploads/image15-1.png" sizes="(max-width: 481px) 100vw, 481px" srcset="https://cdn.confluent.io/wp-content/uploads/image15-1.png 978w, https://cdn.confluent.io/wp-content/uploads/image15-1-300x199.png 300w, https://cdn.confluent.io/wp-content/uploads/image15-1-768x509.png 768w, https://cdn.confluent.io/wp-content/uploads/image15-1-350x232.png 350w, https://cdn.confluent.io/wp-content/uploads/image15-1-600x398.png 600w" alt="Level 0" width="481" height="319" loading="lazy"/><br/>L1–Ln have target sizes. Compaction’s goal is to ensure that L1–Ln is under the target size. Usually, as you move down the level, the target size exponentially increases:</p> <p>After L0 is compacted with L1, L1’s target size is breached:</p> <p>Now, we need to compact L1 with L2. Let’s say that the second SST file on L1 has a newer version of a key where <code>a=4</code>. Let’s also say that the first, second, and third SST file on Level 2 have an older version of a key where <code>a=3</code>, <code>a=2</code>, and <code>a=1</code>. During level compaction, the second SST file on L1 and the first, second, and third SST file on L2 will be merged:</p> <p>As a result of compaction, <strong>four</strong> <em>new</em> SST files will be created on L2. One of the SST files will have an updated version of the key, <code>a=4</code>. All other keys in each of the SST files will remain the same. The older versions of the <code>a</code> key will be discarded:</p> <p>Since L2 has also exceeded its size after compaction, L2 will be compacted into L3. Compaction proceeds from one level to the next until either the target level does not exceed its size or a new target level is created.</p> <h3 id="universal-compaction"><a id="universal-compaction"/>Universal compaction</h3> <p>In <a href="https://github.com/facebook/rocksdb/wiki/Universal-Compaction" target="_blank" rel="noopener">universal compaction</a>, all SST files are organized in chronological order according to the time that the data was written to the SST files. All data written within a specific time range is stored in an individual SST file or in a “level” in key-range-partitioned SST files. One level stores data written during one time range. Each level is a sorted range of SST files.</p> <p>For example, we have five sorted runs here: the three files from L0, L4, and L5. L5 is the oldest sorted run, while <code>File0_0</code> is the newest sorted run.</p> <pre>Level 0: File0_0, File0_1, File0_2 Level 1: (empty) Level 2: (empty) Level 3: (empty) Level 4: File4_0, File4_1, File4_2, File4_3 Level 5: File5_0, File5_1, File5_2, File5_3, File5_4, File5_5 <p><a href="https://github.com/facebook/rocksdb/wiki/Universal-Compaction#compaction-picking-algorithm" target="_blank" rel="noopener">Compaction is triggered</a> in four different ways. For example, one of the ways that compaction can get triggered is if the file is older than the condition set here: <code>options.periodic_compaction_seconds</code>. If the condition is met, then RocksDB proceeds to pick sorted runs for compaction.</p> <p>Compaction occurs among two or more sorted runs of adjacent time ranges. Compaction merges all sorted runs in one level to create a new sorted run in the next level. Compaction outputs are placed in the highest possible level, where older data is located. Timestamps are stored in the level’s metadata.</p> <p>If we compact <code>File0_1</code>, <code>File0_2</code> and L4, the output sorted run will be placed in L4:</p> <pre>Level 0: File0_0, Level 1: (empty) Level 2: (empty) Level 3: (empty) Level 4: File4_0’, File4_1’, File4_2’, File4_3’ Level 5: File5_0, File5_1, File5_2, File5_3, File5_4, File5_5 <p>Here, L4’s metadata will update to contain the earliest timestamp from <code>File0_1</code> to the oldest timestamp on <code>File 4_3</code>. New SST files are created from the compaction, specifically <code>File4_0</code>, and older files are discarded. In contrast to level compaction, the size of the level is irrelevant—what matters is the time range of the data in the SST files. For example, all files on L4 are a day old.</p> <h3 id="level-vs-universal"><a id="level-vs-universal"/>Level compaction vs. universal compaction</h3> <p>Level compaction minimizes space amplification, using less disk space compared with universal compaction. However, level compaction does not support as high of write rates as universal compaction. On the other hand, with universal compaction, the disk space can grow up to twice the size of the data in the store.</p> <p>Kafka Streams uses universal compaction because it supports high write rates. In universal compaction, let’s say we have five SST files with a total size x. When we compact from one level to another, we write no more than the size of the input files, so the write amplification of the compaction job is 1x. In leveled compaction, a set of files of size x in L1 gets compacted with files in L2 that are usually 10 times bigger, so the write amplification of a compaction job would be 11x.</p> <p>It’s important to note that compaction is multithreaded, which means that different parts of the database could be compacted at the same time by multiple threads. You can configure the number of compaction threads in the system to avoid write stalls (<a href="#write-stalls">described later on</a>).</p> <h2 id="tune-rocksdb"><a id="tune-rocksdb"/>How to Tune RocksDB to resolve potential operational issues</h2> <p>In what follows, we’ll describe some operational issues that you may encounter and ways to resolve them.</p> <h3 id="high-memory-usage"><a id="high-memory-usage"/>High memory usage</h3> <p>When your Kafka Streams application has an unexpectedly high memory usage, the RocksDB state stores might be the cause. The symptoms you might experience are:</p> <li>Your Kafka Streams application becomes slow or even crashes with out-of-memory errors</li> <li>Your operating system shows high memory usage</li> <li>These RocksDB-specific metrics exposed by Kafka Streams (introduced with <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-607%3A+Add+Metrics+to+Kafka+Streams+to+Report+Properties+of+RocksDB" target="_blank" rel="noopener">KIP-607</a> and available in <a href="https://www.confluent.io/blog/apache-kafka-2-7-features-updates-improvements/#kip-607" rel="noopener">Apache Kafka 2.7</a> and above) show high values: <li><code>size-all-mem-tables</code></li> <li><code>block-cache-usage</code></li> <li><code>block-cache-pinned-usage</code></li> <li><code>estimate-table-readers-mem</code></li> <p>To cope with the high memory usage, you can take the following actions.</p> <h4 id="investigate-memtable"><a id="investigate-memtable"/>Investigate the memtable</h4> <p>The high memory usage can come from the memtables. You’ll have to look at the memtable size and how many memtables you have configured in Kafka Streams. The corresponding options that you can tune in your <code>RocksDBConfigSetter</code> implementation are:</p> <li><code>options.setMaxWriteBufferNumber();</code></li> <li><code>options.setWriteBufferSize();</code></li> <h4 id="investigate-block-cache"><a id="investigate-block-cache"/>Investigate the block cache</h4> <p>For every RocksDB state store in a Kafka Streams application, you have a different block cache. However, you can configure a global block cache. You can share the block cache across all RocksDB state stores that run in one single Kafka Streams client as described in the <a href="https://docs.confluent.io/platform/current/streams/developer-guide/memory-mgmt.html#rocksdb" target="_blank" rel="noopener"><code>BoundedMemoryRocksDBConfig</code></a> in the Kafka Streams documentation. You can even limit the memory used by the shared block cache and memtables of the RocksDB state stores in the same Kafka Streams client by counting the memory used by the memtables against the shared block cache.</p> <h4 id="known-bugs"><a id="known-bugs"/>Check out RocksDB known bugs</h4> <p>Kafka Streams uses the RocksDB Java API. Certain bugs are memory related that the community is fixing. You can find the <a href="https://github.com/facebook/rocksdb/issues?q=is%3Aissue+is%3Aopen+OOM" target="_blank" rel="noopener">known bugs and community information</a> on GitHub.</p> <h3 id="high-disk-usage"><a id="high-disk-usage"/>High disk usage</h3> <p>Similar to high memory usage, you might also experience high disk usage due to RocksDB state stores in your Kafka Streams application. The symptoms you might experience are:</p> <li>Application crashes with I/O errors</li> <li>Operating system shows high disk usage for the state directories used by RocksDB</li> <li><code>total-sst-files-size</code> (introduced with <a href="https://cwiki.apache.org/confluence/display/KAFKA/KIP-607%3A+Add+Metrics+to+Kafka+Streams+to+Report+Properties+of+RocksDB" target="_blank" rel="noopener">KIP-607</a> and available in <a href="https://github.com/facebook/rocksdb/issues?q=is%3Aissue+is%3Aopen+OOM" target="_blank" rel="noopener">Apache Kafka 2.7</a> and above) shows high values.</li> <p>To cope with the high disk usage, you can take the following actions:</p> <h4 id="use-level-compaction"><a id="use-level-compaction"/>Use level compaction</h4> <p>Kafka Streams uses universal compaction by default for its state stores. However, level compaction has lower space amplification than universal compaction at the cost of lower write rates. The corresponding option that you can tune in your <code>RocksDBConfigSetter</code> implementation is <code>options.setCompactionStyle(CompactionStyle.LEVEL)</code>.</p> <h4 id="provision-disk-space"><a id="provision-disk-space"/>Provision more disk space</h4> <p>For universal compaction, some users use a lot of disk space because of the trade-off of space amplification vs. the ability to support a very high write rate. Also, you may experience temporary disk usage spikes. As a rule of thumb, we recommend provisioning more disk space to ensure that you can continue to operate your system without getting errors.</p> <h3 id="write-stalls"><a id="write-stalls"/>High disk I/O and write stalls</h3> <p>Besides high disk and high memory usage, you might also experience high disk I/O and write stalls. The symptoms you might experience are:</p> <li>Operating system shows high disk I/O</li> <li>Processing latency of the application increases</li> <li>Kafka Streams client gets kicked out of the consumer group</li> <li>The following RocksDB-specific metrics exposed by Kafka Streams show high values: <li><code>memtable-bytes-flushed-[rate | total]</code></li> <li><code>bytes-[read | written]-compaction-rate</code></li> <li><code>metric write-stall-duration-[avg | total]</code></li> <li>The following RocksDB-specific metrics exposed by Kafka Streams show low values: <li><code>memtable-hit-ratio</code></li> <li><code>block-cache-[data | index | filter]-hit-ratio</code></li> <p>To cope with the high I/O and write stalls, you can take the following actions:</p> <h4 id="disk-io-utilization"><a id="disk-io-utilization"/>Look at the disk I/O utilization</h4> <p>When you first encounter write stalls, check to see if the hardware is the bottleneck. For example, are you doing too many writes? For this, you can look at I/O utilization.</p> <h4 id="background-compaction"><a id="background-compaction"/>Check the number of background compaction threads</h4> <p>By default, Kafka Streams configures RocksDB to use as many background compaction threads as the number of available processors, but it configures two background compaction threads if only one processor is available. If you are getting write stalls, manually verify the compaction threads utilization. You can increase the number of background compaction threads in your <code>RocksDBConfigSetter</code> implementation by using <code>options.setIncreaseParallelism()</code>.</p> <h4 id="increase-memtables"><a id="increase-memtables"/>Increase the number and size of memtables and block cache</h4> <p>All data held in the memtables or block caches do not need to be read from disk when they are looked up; this decreases I/O. You can keep more data in memtables and block caches if you increase their sizes. However, be careful not to run out of memory.</p> <h4 id="increase-max.poll.interval.ms"><a id="increase-max.poll.interval.ms"/>Increase <code>max.poll.interval.ms</code></h4> <p>The configuration <a href="https://docs.confluent.io/platform/current/installation/configuration/consumer-configs.html#max.poll.interval.ms" target="_blank" rel="noopener"><code>max.poll.interval.ms</code></a> is the maximum delay between invocations of <code>poll()</code> when using consumer group management (default: five minutes). Once a consumer within a Kafka Streams client exceeds this delay, the consumer is kicked out of the consumer group, leading to recurring rebalances and increased processing lag. If writes to RocksDB stall, the time interval between the invocations of <code>poll()</code> may exceed <code>max.poll.interval.ms</code>. To avoid this, you can increase <code>max.poll.interval.ms</code> in your Kafka Streams application.</p> <h3 id="open-files"><a id="open-files"/>Too many open files</h3> <p>By default, Kafka Streams configures RocksDB state stores to not limit the number of open files (i.e., <code>max_open_files</code> = -1). This means that the database opens all the SST files and keeps a file pointer to each one of them. This is great for performance, but you might run out of file descriptors and experience the following symptoms:</p> <li>Application crashes with I/O errors</li> <li>Kafka Streams metric <code>number-open-files</code> shows high values</li> <p>To get rid of this issue, you can take the following actions:</p> <h4 id="operating-system-limit"><a id="operating-system-limit"/>Increase the operating system limit</h4> <p>You can increase the operating system limit to a large number and keep the option <code>max_open_files</code> at -1.</p> <h4 id="set-limit"><a id="set-limit"/>Set a limit for open files in RocksDB</h4>