{"id":27756,"date":"2025-06-05T08:48:49","date_gmt":"2025-06-05T15:48:49","guid":{"rendered":"https:\/\/www.pingcap.com\/?p=27756"},"modified":"2025-06-05T08:48:51","modified_gmt":"2025-06-05T15:48:51","slug":"scaling-metadata-management-innovations-tidb-placement-driver","status":"publish","type":"post","link":"https:\/\/www.pingcap.com\/ko\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/","title":{"rendered":"Scaling Metadata Management: Innovations in TiDB\u2019s Placement Driver"},"content":{"rendered":"<p>As <a href=\"https:\/\/www.pingcap.com\/ko\/tidb-self-managed\/\">\ud2f0DB<\/a> scales to support larger deployments, its core metadata management hub\u2014the Placement Driver (PD)\u2014must evolve to meet growing demands. This post explores how TiDB addresses PD\u2019s challenges, including scalability bottlenecks, stability risks, and storage limitations.<\/p>\n\n\n\n<p>In this post, we\u2019ll cover:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The shift to a microservices architecture for module isolation and scalability.<\/li>\n\n\n\n<li>Innovations like Active Followers and the planned Router Service for efficient metadata management.<\/li>\n\n\n\n<li>Governance strategies ensuring high availability and stability.<\/li>\n<\/ul>\n\n\n\n<p>Whether you\u2019re optimizing large-scale deployments or curious about <a href=\"https:\/\/docs.pingcap.com\/tidb\/stable\/tidb-architecture\/\">TiDB\u2019s architecture<\/a>, this post highlights how PD is evolving to handle modern, distributed workloads. Let\u2019s dive in!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"What_is_the_Placement_Driver\"><\/span>What is the Placement Driver?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>The <a href=\"https:\/\/docs.pingcap.com\/tidb\/stable\/configure-placement-rules\/\">Placement Driver (PD)<\/a> acts as TiDB\u2019s brain, managing metadata, balancing workloads, and ensuring consistency across distributed systems. Its primary responsibilities include:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Maintaining real-time metadata on data distribution across TiKV nodes.<\/li>\n\n\n\n<li>Managing the topology of the TiDB cluster.<\/li>\n\n\n\n<li>Allocating globally monotonically increasing timestamps.<\/li>\n\n\n\n<li>Balancing load and capacity between nodes.<\/li>\n<\/ul>\n\n\n\n<p>PD ensures smooth operation and coordination in TiDB\u2019s distributed architecture.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"550\" src=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072621\/image-1024x550.png\" alt=\"TiDB's placement driver (PD) architecture.\" class=\"wp-image-27763\" srcset=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072621\/image-1024x550.png 1024w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072621\/image-300x161.png 300w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072621\/image-768x412.png 768w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072621\/image.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>Figure 1. A breakdown of TiDB&#8217;s distributed architecture.<\/em><\/figcaption><\/figure>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Inside_TiDBs_Metadata_Management_Controller\"><\/span>Inside TiDB&#8217;s Metadata Management Controller<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>PD\u2019s functionality is distributed across several specialized modules, each tailored to specific tasks:<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Key PD Modules<\/h3>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"929\" height=\"676\" src=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072637\/image-1.png\" alt=\"\" class=\"wp-image-27764\" srcset=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072637\/image-1.png 929w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072637\/image-1-300x218.png 300w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072637\/image-1-768x559.png 768w\" sizes=\"auto, (max-width: 929px) 100vw, 929px\" \/><figcaption class=\"wp-element-caption\"><em>Figure 2. How TiDB&#8217;s PD functionality is distributed for specific tasks.<\/em><\/figcaption><\/figure>\n<\/div>\n\n\n<h4 class=\"wp-block-heading\"><a href=\"https:\/\/docs.pingcap.com\/tidb\/stable\/tso\/#:~:text=In%20TiDB%2C%20the%20Placement%20Driver,the%20Percolator%20model%20within%20TiDB.\">Timestamp Oracle (TSO) Module (High Priority, High QPS)<\/a>:<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Allocates globally monotonically increasing timestamps for transaction consistency.<\/li>\n\n\n\n<li>Requires a strong leader for operation due to its critical role in TiDB\u2019s transactional model.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><a href=\"https:\/\/docs.pingcap.com\/tidb\/stable\/tidb-scheduling\/\">Scheduling Module (Background Tasks)<\/a>:<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Manages workload distribution by scheduling regions across TiKV nodes.<\/li>\n\n\n\n<li>Operates without a strong leader but can face bottlenecks in large clusters during operator execution.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Router Module (High Priority, High QPS):<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Handles metadata operations like region additions, updates, and removals.<\/li>\n\n\n\n<li>Requires optimization to overcome scalability limits imposed by the strong leader model.<\/li>\n\n\n\n<li>Processes two types of heartbeats:\n<ul class=\"wp-block-list\">\n<li><strong>Region<\/strong><strong> Metadata:<\/strong> High-priority data critical for DDL and DML operations.<\/li>\n\n\n\n<li><strong>Region<\/strong><strong> Statistics:<\/strong> Lower-priority data used by the Scheduling Service for operator generation.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Opportunities for Innovation<\/h3>\n\n\n\n<p>TiDB is addressing these challenges with exciting advancements:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><a href=\"https:\/\/docs.pingcap.com\/tidb\/stable\/tidb-resource-control-ru-groups\/\">Resource Isolation<\/a>:<\/strong> Decoupling modules to prevent interference between tasks of differing priorities.<\/li>\n\n\n\n<li><strong>Flexible Scaling:<\/strong> Reducing reliance on the strong leader model for high-QPS tasks like metadata management.<\/li>\n\n\n\n<li><strong>Follower Utilization:<\/strong> Leveraging PD follower nodes for read-heavy tasks has already improved performance by up to 4.5x.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Decoupling_Placement_Driver_Services_for_Scalability\"><\/span>Decoupling Placement Driver Services for Scalability<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>To overcome these limitations, TiDB has transitioned PD to a microservices architecture. This isolates key modules into independent services, enabling better scalability and reliability.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Key Placement Driver Microservices<\/h3>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"985\" height=\"726\" src=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072657\/image-2.png\" alt=\"How TiDB's placement driver (PD) has transitioned to a microservices architecture for enhanced metadata management.\" class=\"wp-image-27766\" srcset=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072657\/image-2.png 985w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072657\/image-2-300x221.png 300w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072657\/image-2-768x566.png 768w\" sizes=\"auto, (max-width: 985px) 100vw, 985px\" \/><figcaption class=\"wp-element-caption\"><em>Figure 3. TiDB&#8217;s new PD architecture for enhanced scalability.<\/em><\/figcaption><\/figure>\n<\/div>\n\n\n<h4 class=\"wp-block-heading\">TSO Service:<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Operates as a standalone service since TiDB 8.0, ensuring high throughput without interference.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Scheduling Service:<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Decoupled as of TiDB 8.0 to handle scheduling independently, tolerating minor delays without disrupting critical tasks.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Router Service (Planned):<\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The Router Module will be transitioned into a stateless service to process high-QPS metadata operations in parallel, eliminating bottlenecks.<\/li>\n<\/ul>\n\n\n\n<h5 class=\"wp-block-heading\">Heartbeat Optimizations in Router Service<\/h5>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Dedicated Metadata Access:<\/strong> The planned Router Service will process metadata independently, preventing heartbeats from overwhelming critical tasks.<\/li>\n\n\n\n<li><strong>Decoupled Statistics Updates:<\/strong> Region statistics updates will be handled separately, minimizing their impact on metadata operations.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Achievements from Service Isolation<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Stability:<\/strong> Critical tasks like timestamp allocation are unaffected by background jobs.<\/li>\n\n\n\n<li><strong>Efficiency:<\/strong> Each service can be optimized for its specific workload.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Building_a_Resilient_and_Scalable_Metadata_Management_Controller\"><\/span>Building a Resilient and Scalable Metadata Management Controller<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>TiDB has introduced governance strategies to support PD\u2019s microservices architecture:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Infrastructure Updates:<\/strong> Service registry, discovery, node balancers, and API gateways streamline operations.<\/li>\n\n\n\n<li><strong>Stability Enhancements:<\/strong> Rate limiters, circuit breakers, and optimized retry strategies ensure reliable performance under stress.<\/li>\n<\/ul>\n\n\n\n<p>As TiDB transitions PD to a microservices architecture, service governance is evolving to enhance resilience, high availability (HA), and stability. These updates address the unique needs of both stateless and stateful components while preparing PD for modern workloads.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Enhancing High Availability<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Stateless Services:<\/strong> The microservices approach simplifies failover and recovery, enabling faster response to disruptions.<\/li>\n\n\n\n<li><strong>Stateful Components:<\/strong> With stateless services streamlined, focus shifts to ensuring HA for stateful modules, maintaining reliability under heavy workloads.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Key Infrastructure Updates<\/h3>\n\n\n\n<p>To support the microservices model, TiDB is introducing critical components:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Service Registry and Discovery:<\/strong> Automates service management and interaction within the cluster.<\/li>\n\n\n\n<li><strong>Node Balancer:<\/strong> Distributes workloads across Active Followers and stateless services to optimize performance.<\/li>\n\n\n\n<li><strong>API Gateway:<\/strong> Centralizes traffic control for secure, efficient communication.<\/li>\n\n\n\n<li><strong>Enhanced PD Client:<\/strong> Provides a unified interface for seamless integration with new tools.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Strengthening Stability<\/h3>\n\n\n\n<p>New stability measures ensure PD operates reliably under stress:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Rate Limiter:<\/strong> Controls incoming request loads.<\/li>\n\n\n\n<li><strong>Circuit Breaker:<\/strong> Prevents cascading failures.<\/li>\n\n\n\n<li><strong>Timeout and Retry Optimization:<\/strong> Streamlines recovery from transient issues.<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">A Smarter, Scalable PD<\/h3>\n\n\n\n<p>These governance updates ensure PD is robust, efficient, and ready for the demands of large-scale workloads. By combining microservices flexibility with HA and stability enhancements, TiDB positions PD as a future-ready metadata management solution.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Enhancing_PD_Scalability_The_Role_of_Strong_Leaders_in_Metadata_Management\"><\/span>Enhancing PD Scalability: The Role of Strong Leaders in Metadata Management<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>The TSO Service, which ensures consistent timestamps across distributed systems, depends on a strong leader for its centralized clock solution. However, modules like the Scheduling Service, Router Service, and Admin Control Service don\u2019t strictly require strong leadership. Historically, all PD modules operated under a strong leader model, limiting horizontal scalability and introducing inefficiencies.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Active Followers<\/h3>\n\n\n\n<p>PD introduced <strong>Active Followers<\/strong>, enabling follower nodes to process metadata reads and writes, significantly reducing the workload on the leader node:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>How It Works:<\/strong> Follower nodes handle high-QPS operations like GetRegion requests, leveraging idle resources. The client-side retry mechanism ensures consistency when reading stale metadata.<\/li>\n\n\n\n<li><strong>Performance Gains:<\/strong> Internal testing shows up to 4.5x improvement in GetRegion request processing with 5 PD nodes. This feature, experimental in TiDB 7.6 and GA in TiDB 8.5, demonstrates the potential for leveraging follower nodes to improve scalability.<\/li>\n<\/ul>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"721\" height=\"711\" src=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072728\/image-3.png\" alt=\"How TiDB handles Active Followers for enhanced metadata management.\" class=\"wp-image-27767\" srcset=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072728\/image-3.png 721w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072728\/image-3-300x296.png 300w\" sizes=\"auto, (max-width: 721px) 100vw, 721px\" \/><figcaption class=\"wp-element-caption\"><em>Figure 4. How TiDB handles Active Followers.<\/em><\/figcaption><\/figure>\n<\/div>\n\n\n<h3 class=\"wp-block-heading\">Stateless Router Service (Planned)<\/h3>\n\n\n\n<p>The planned Router Service will transform the Router Module into a stateless microservice, decoupling logic processing from state management to enable linear scaling:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Improved Parallelism:<\/strong> Each Router Service node will independently process metadata updates (heartbeats) and store the results in both a cache and a storage layer, reducing contention.<\/li>\n\n\n\n<li><strong>Heartbeat Optimizations:<\/strong>\n<ul class=\"wp-block-list\">\n<li><strong>Dedicated Metadata Access:<\/strong> High-priority region metadata operations (e.g., GetRegion) will no longer be impacted by heartbeats.<\/li>\n\n\n\n<li><strong>Decoupled Statistics Updates:<\/strong> Region statistics updates, needed by the Scheduling Service, will be processed separately, reducing interference.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"706\" src=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072750\/image-4-1024x706.png\" alt=\"How the planned Router Service transforms the Router Module into a stateless microservice for enhanced metadata management.\" class=\"wp-image-27768\" srcset=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072750\/image-4-1024x706.png 1024w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072750\/image-4-300x207.png 300w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072750\/image-4-768x530.png 768w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072750\/image-4.png 1031w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>Figure 5. How the planned Router Service transforms the Router Module into a stateless microservice.<\/em><\/figcaption><\/figure>\n<\/div>\n\n\n<h3 class=\"wp-block-heading\">TiKV-Based Storage<\/h3>\n\n\n\n<p>TiDB plans to redesign PD\u2019s storage layer by transitioning from LevelDB to <a href=\"https:\/\/docs.pingcap.com\/tidb\/stable\/tikv-overview\/\">TiKV<\/a>, its highly scalable distributed storage engine:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Two-Tier Structure:<\/strong>\n<ul class=\"wp-block-list\">\n<li><strong>Tier 1:<\/strong> Maps regions to TiKV nodes.<\/li>\n\n\n\n<li><strong>Tier 2:<\/strong> Stores detailed region metadata for operations.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Benefits: <\/strong>Decoupling compute and storage layers enables independent scaling, allowing PD to handle growing workloads without bottlenecks.<\/li>\n<\/ul>\n\n\n\n<p>These enhancements ensure that PD can scale efficiently to support the increasing demands of modern deployments.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"562\" src=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072819\/image-5-1024x562.png\" alt=\"\" class=\"wp-image-27769\" srcset=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05072819\/image-5-1024x562.png 1024w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072819\/image-5-300x165.png 300w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072819\/image-5-768x421.png 768w, https:\/\/static.pingcap.com\/files\/2025\/06\/05072819\/image-5.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\"><em>Figure 6. How PD&#8217;s storage layer scales more efficiently on TiKV.<\/em><\/figcaption><\/figure>\n<\/div>\n\n\n<h3 class=\"wp-block-heading\">Remaining Scalability Challenges<\/h3>\n\n\n\n<p>Despite these advancements, a few challenges remain:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Single Leader Dependency:<\/strong> While features like Active Followers alleviate leader bottlenecks, most services still depend on a strong leader, limiting full horizontal scalability.<\/li>\n\n\n\n<li><strong>Scheduling Service Bottlenecks:<\/strong>\n<ul class=\"wp-block-list\">\n<li>The Scheduling Service remains in strong leader mode and can face bottlenecks during heavy statistics heartbeats.<\/li>\n\n\n\n<li>However, as a lower-priority service, it can tolerate delays and even discard excess heartbeats without affecting overall functionality.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Coupled Storage and Compute Layers:<\/strong> Further decoupling is essential to enable fully independent scaling of these resources.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Conclusion_Unlocking_the_Future_of_Metadata_Management\"><\/span>Conclusion: Unlocking the Future of Metadata Management<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>The introduction of microservices represents a significant leap forward for PD\u2019s architecture. Future enhancements, such as stateless Router Services and reducing leader dependencies, will further unlock PD\u2019s potential to meet the demands of modern, large-scale TiDB clusters.<\/p>\n\n\n\n<p>TiDB\u2019s PD is evolving to meet the demands of large-scale, modern workloads. With features like TSO Service, Scheduling Service, and Active Followers already boosting performance, and future plans for Router Service and TiKV integration, PD is becoming more scalable, reliable, and efficient. These innovations address real-world challenges like module interference and strong leader bottlenecks, ensuring PD remains a robust metadata management solution.<\/p>\n\n\n\n<p><em>Want to see how TiDB handles metadata at scale? <a href=\"https:\/\/tidbcloud.com\/free-trial\/?__hstc=86493575.ff95dbac4fbe967f51f3df3d957eb3e3.1748908180053.1749043665350.1749047945711.11&amp;__hssc=86493575.2.1749047945711&amp;__hsfp=604052937&amp;_gl=1*1k9cnst*_gcl_au*MTUyNjMzODk1LjE3NDg5MDgxODY.*_ga*NzMzNDU2OTg2LjE3NDg5MDgxODA.*_ga_9FRXHHPYVY*czE3NDkwNDc5NDMkbzEyJGcxJHQxNzQ5MDQ4OTgwJGo2MCRsMCRoMA..*_ga_3JVXJ41175*czE3NDkwNDc5NDMkbzExJGcxJHQxNzQ5MDQ4OTgxJGo2MCRsMCRoNTExNTE0OTg.*_ga_ZEL0RNV6R2*czE3NDkwNDc5NDMkbzExJGcxJHQxNzQ5MDQ4MjI3JGo2MCRsMCRoMA..&amp;website_referrer_url=https:\/\/www.google.com\/\">Launch a free TiDB cluster<\/a> to experience real-time metadata operations, elastic scaling, and resilient distributed performance.<\/em><\/p>\n\n\n\n<p><\/p>","protected":false},"excerpt":{"rendered":"<p>As TiDB scales to support larger deployments, its core metadata management hub\u2014the Placement Driver (PD)\u2014must evolve to meet growing demands. This post explores how TiDB addresses PD\u2019s challenges, including scalability bottlenecks, stability risks, and storage limitations. In this post, we\u2019ll cover: Whether you\u2019re optimizing large-scale deployments or curious about TiDB\u2019s architecture, this post highlights how [&hellip;]<\/p>\n","protected":false},"author":302,"featured_media":27773,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"ub_ctt_via":"","footnotes":""},"categories":[6],"tags":[147,16,410,9,111],"class_list":["post-27756","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-engineering","tag-distributed-sql","tag-distributed-system","tag-metadata-management-2","tag-scalability","tag-tidb"],"acf":[],"featured_image_src":"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png","author_info":{"display_name":"Chris Xu","author_link":"https:\/\/www.pingcap.com\/ko\/blog\/author\/cxu\/"},"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Metadata Management Evolved: Scaling TiDB&#039;s Placement Driver<\/title>\n<meta name=\"description\" content=\"Explore how TiDB addresses metadata management challenges, including scalability bottlenecks, stability risks, and storage limitations.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.pingcap.com\/ko\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\" \/>\n<meta property=\"og:locale\" content=\"ko_KR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Metadata Management Evolved: Scaling TiDB&#039;s Placement Driver\" \/>\n<meta property=\"og:description\" content=\"Explore how TiDB addresses metadata management challenges, including scalability bottlenecks, stability risks, and storage limitations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.pingcap.com\/ko\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\" \/>\n<meta property=\"og:site_name\" content=\"TiDB\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/pingcap2015\" \/>\n<meta property=\"article:published_time\" content=\"2025-06-05T15:48:49+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-06-05T15:48:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05083903\/tidb_1200x627.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2400\" \/>\n\t<meta property=\"og:image:height\" content=\"1254\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Chris Xu\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05083920\/tidb_twitter_1600x900-scaled.png\" \/>\n<meta name=\"twitter:creator\" content=\"@PingCAP\" \/>\n<meta name=\"twitter:site\" content=\"@PingCAP\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Chris Xu\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7\ubd84\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\"},\"author\":{\"name\":\"Chris Xu\",\"@id\":\"https:\/\/www.pingcap.com\/#\/schema\/person\/3fe6ebc173de3c989800fa639f343ee9\"},\"headline\":\"Scaling Metadata Management: Innovations in TiDB\u2019s Placement Driver\",\"datePublished\":\"2025-06-05T15:48:49+00:00\",\"dateModified\":\"2025-06-05T15:48:51+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\"},\"wordCount\":1356,\"publisher\":{\"@id\":\"https:\/\/www.pingcap.com\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png\",\"keywords\":[\"Distributed SQL\",\"Distributed system\",\"Metadata Management\",\"Scalability\",\"TiDB\"],\"articleSection\":[\"Engineering\"],\"inLanguage\":\"ko-KR\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\",\"url\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\",\"name\":\"Metadata Management Evolved: Scaling TiDB's Placement Driver\",\"isPartOf\":{\"@id\":\"https:\/\/www.pingcap.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png\",\"datePublished\":\"2025-06-05T15:48:49+00:00\",\"dateModified\":\"2025-06-05T15:48:51+00:00\",\"description\":\"Explore how TiDB addresses metadata management challenges, including scalability bottlenecks, stability risks, and storage limitations.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#breadcrumb\"},\"inLanguage\":\"ko-KR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"ko-KR\",\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage\",\"url\":\"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png\",\"contentUrl\":\"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png\",\"width\":2560,\"height\":853},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.pingcap.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Scaling Metadata Management: Innovations in TiDB\u2019s Placement Driver\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.pingcap.com\/#website\",\"url\":\"https:\/\/www.pingcap.com\/\",\"name\":\"TiDB\",\"description\":\"TiDB | SQL at Scale\",\"publisher\":{\"@id\":\"https:\/\/www.pingcap.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.pingcap.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ko-KR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.pingcap.com\/#organization\",\"name\":\"PingCAP\",\"url\":\"https:\/\/www.pingcap.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ko-KR\",\"@id\":\"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png\",\"contentUrl\":\"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png\",\"width\":811,\"height\":232,\"caption\":\"PingCAP\"},\"image\":{\"@id\":\"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/facebook.com\/pingcap2015\",\"https:\/\/x.com\/PingCAP\",\"https:\/\/linkedin.com\/company\/pingcap\",\"https:\/\/youtube.com\/channel\/UCuq4puT32DzHKT5rU1IZpIA\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.pingcap.com\/#\/schema\/person\/3fe6ebc173de3c989800fa639f343ee9\",\"name\":\"Chris Xu\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ko-KR\",\"@id\":\"https:\/\/www.pingcap.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/static.pingcap.com\/files\/2022\/10\/17234942\/avatar.jpg\",\"contentUrl\":\"https:\/\/static.pingcap.com\/files\/2022\/10\/17234942\/avatar.jpg\",\"caption\":\"Chris Xu\"},\"description\":\"Lead Software Engineer\",\"url\":\"https:\/\/www.pingcap.com\/ko\/blog\/author\/cxu\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Metadata Management Evolved: Scaling TiDB's Placement Driver","description":"Explore how TiDB addresses metadata management challenges, including scalability bottlenecks, stability risks, and storage limitations.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.pingcap.com\/ko\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/","og_locale":"ko_KR","og_type":"article","og_title":"Metadata Management Evolved: Scaling TiDB's Placement Driver","og_description":"Explore how TiDB addresses metadata management challenges, including scalability bottlenecks, stability risks, and storage limitations.","og_url":"https:\/\/www.pingcap.com\/ko\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/","og_site_name":"TiDB","article_publisher":"https:\/\/facebook.com\/pingcap2015","article_published_time":"2025-06-05T15:48:49+00:00","article_modified_time":"2025-06-05T15:48:51+00:00","og_image":[{"width":2400,"height":1254,"url":"https:\/\/static.pingcap.com\/files\/2025\/06\/05083903\/tidb_1200x627.png","type":"image\/png"}],"author":"Chris Xu","twitter_card":"summary_large_image","twitter_image":"https:\/\/static.pingcap.com\/files\/2025\/06\/05083920\/tidb_twitter_1600x900-scaled.png","twitter_creator":"@PingCAP","twitter_site":"@PingCAP","twitter_misc":{"Written by":"Chris Xu","Est. reading time":"7\ubd84"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#article","isPartOf":{"@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/"},"author":{"name":"Chris Xu","@id":"https:\/\/www.pingcap.com\/#\/schema\/person\/3fe6ebc173de3c989800fa639f343ee9"},"headline":"Scaling Metadata Management: Innovations in TiDB\u2019s Placement Driver","datePublished":"2025-06-05T15:48:49+00:00","dateModified":"2025-06-05T15:48:51+00:00","mainEntityOfPage":{"@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/"},"wordCount":1356,"publisher":{"@id":"https:\/\/www.pingcap.com\/#organization"},"image":{"@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage"},"thumbnailUrl":"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png","keywords":["Distributed SQL","Distributed system","Metadata Management","Scalability","TiDB"],"articleSection":["Engineering"],"inLanguage":"ko-KR"},{"@type":"WebPage","@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/","url":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/","name":"Metadata Management Evolved: Scaling TiDB's Placement Driver","isPartOf":{"@id":"https:\/\/www.pingcap.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage"},"image":{"@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage"},"thumbnailUrl":"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png","datePublished":"2025-06-05T15:48:49+00:00","dateModified":"2025-06-05T15:48:51+00:00","description":"Explore how TiDB addresses metadata management challenges, including scalability bottlenecks, stability risks, and storage limitations.","breadcrumb":{"@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#breadcrumb"},"inLanguage":"ko-KR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/"]}]},{"@type":"ImageObject","inLanguage":"ko-KR","@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#primaryimage","url":"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png","contentUrl":"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png","width":2560,"height":853},{"@type":"BreadcrumbList","@id":"https:\/\/www.pingcap.com\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.pingcap.com\/"},{"@type":"ListItem","position":2,"name":"Scaling Metadata Management: Innovations in TiDB\u2019s Placement Driver"}]},{"@type":"WebSite","@id":"https:\/\/www.pingcap.com\/#website","url":"https:\/\/www.pingcap.com\/","name":"\ud2f0DB","description":"TiDB | SQL at Scale","publisher":{"@id":"https:\/\/www.pingcap.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.pingcap.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ko-KR"},{"@type":"Organization","@id":"https:\/\/www.pingcap.com\/#organization","name":"PingCAP","url":"https:\/\/www.pingcap.com\/","logo":{"@type":"ImageObject","inLanguage":"ko-KR","@id":"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/","url":"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png","contentUrl":"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png","width":811,"height":232,"caption":"PingCAP"},"image":{"@id":"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/facebook.com\/pingcap2015","https:\/\/x.com\/PingCAP","https:\/\/linkedin.com\/company\/pingcap","https:\/\/youtube.com\/channel\/UCuq4puT32DzHKT5rU1IZpIA"]},{"@type":"Person","@id":"https:\/\/www.pingcap.com\/#\/schema\/person\/3fe6ebc173de3c989800fa639f343ee9","name":"Chris Xu","image":{"@type":"ImageObject","inLanguage":"ko-KR","@id":"https:\/\/www.pingcap.com\/#\/schema\/person\/image\/","url":"https:\/\/static.pingcap.com\/files\/2022\/10\/17234942\/avatar.jpg","contentUrl":"https:\/\/static.pingcap.com\/files\/2022\/10\/17234942\/avatar.jpg","caption":"Chris Xu"},"description":"Lead Software Engineer","url":"https:\/\/www.pingcap.com\/ko\/blog\/author\/cxu\/"}]}},"grav_blocks":false,"card_markup":"<a class=\"card-resource bg-white\" href=\"https:\/\/www.pingcap.com\/ko\/blog\/scaling-metadata-management-innovations-tidb-placement-driver\/\"><div class=\"card-resource__image-container\"><img class=\"card-resource__image\" alt=\"tidb_feature_1800x600 (1)\" src=\"https:\/\/static.pingcap.com\/files\/2025\/06\/05083848\/tidb_feature_1800x600-1-scaled.png\" loading=\"lazy\" width=2560 height=853 \/><\/div><div class=\"card-resource__content-container\"><div class=\"card-resource__content-head\"><div class=\"card-resource__category\">Engineering<\/div><\/div><h5 class=\"card-resource__title\">Scaling Metadata Management: Innovations in TiDB\u2019s Placement Driver<\/h5><\/div><\/a>","_links":{"self":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/posts\/27756","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/users\/302"}],"replies":[{"embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/comments?post=27756"}],"version-history":[{"count":7,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/posts\/27756\/revisions"}],"predecessor-version":[{"id":27779,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/posts\/27756\/revisions\/27779"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/media\/27773"}],"wp:attachment":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/media?parent=27756"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/categories?post=27756"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/tags?post=27756"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}