{"id":14172,"date":"2023-10-10T19:42:47","date_gmt":"2023-10-11T02:42:47","guid":{"rendered":"https:\/\/www.pingcap.com\/?post_type=case-study&#038;p=14172"},"modified":"2024-05-30T23:18:54","modified_gmt":"2024-05-31T06:18:54","slug":"database-consolidation-dynamodb-amazon-redshift-tidb","status":"publish","type":"case-study","link":"https:\/\/www.pingcap.com\/ko\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/","title":{"rendered":"How Micoworks Consolidated Amazon DynamoDB and Redshift Workloads with TiDB"},"content":{"rendered":"<p>In today&#8217;s data-driven world, databases serve as the backbone for not just recording and analyzing business data, but also for accumulating diverse data sets such as customer interactions and social media metrics for effective engagement with customers.&nbsp;<\/p>\n\n\n\n<p>Micoworks is the Japanese company behind MicoCloud, an SNS communication platform that helps businesses engage with their customers. MicoCloud aims to &#8220;maximize sales and reduce operating costs&#8221; by optimizing interactions between companies and their customers. Through integrations with various communication channels like LINE, MicoCloud encourages customer loyalty while providing business visibility into customer behavior. MicoCloud is scaling fast, serving over 600 corporate customers, including \u00a0Hankyu Hanshin Department Store, Kyoto Toyopet, and Watami.\u00a0\u00a0<\/p>\n\n\n\n<p>This case study explores how Micoworks successfully integrated TiDB, an advanced open-source, distributed SQL database, to streamline its large-scale data operations and analytics.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"The_Problem_Challenges_with_Multi-database_Infrastructure\"><\/span>The Problem: Challenges with Multi-database Infrastructure<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Originally, MicoCloud\u2019s data infrastructure included three different databases:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Amazon DynamoDB: A NoSQL database holding diverse customer attributes.<\/li>\n\n\n\n<li>Amazon Aurora MySQL: A relational master database for corporate data.<\/li>\n\n\n\n<li>Amazon Redshift: A data warehouse tailored for analytical needs.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"960\" height=\"540\" src=\"https:\/\/static.pingcap.com\/files\/2023\/10\/10030150\/image-1.png\" alt=\"\" class=\"wp-image-14174\" srcset=\"https:\/\/static.pingcap.com\/files\/2023\/10\/10030150\/image-1.png 960w, https:\/\/static.pingcap.com\/files\/2023\/10\/10030150\/image-1-300x169.png 300w, https:\/\/static.pingcap.com\/files\/2023\/10\/10030150\/image-1-768x432.png 768w\" sizes=\"auto, (max-width: 960px) 100vw, 960px\" \/><\/figure>\n\n\n\n<p class=\"has-text-align-center\"><em>Figure 1: MicoCloud&#8217;s Architecture before TiDB<\/em><\/p>\n\n\n\n<p>As MicoCloud scaled rapidly, operating these three databases became increasingly complex. Specifically, this database system had several challenges:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Data transfer complexity<\/strong>: Transferring data from DynamoDB and Amazon Aurora MySQL to Amazon Redshift for data aggregation was complex and time-consuming.<\/li>\n\n\n\n<li><strong>Operational overhead<\/strong>: Each database required different monitoring and management procedures, which added to the operational complexity.<\/li>\n\n\n\n<li><strong>Performance bottlenecks<\/strong>: Micoworks\u2019 data warehouse\u2014Amazon Redshift\u2014was a bottleneck for data analysis. This was because Redshift is not designed for high-volume data analysis.<\/li>\n<\/ul>\n\n\n\n<p>&#8220;As we couldn&#8217;t fully optimize the performance of Amazon Redshift, we needed a more scalable solution,&#8221; said Mr. Han Chen, Senior Specialist, SRE Team, Product Management Division.&nbsp;<\/p>\n\n\n\n<p>Micoworks needed a unified database infrastructure that could handle large amounts of data and provide high performance for data analysis. As the team put it, the alternative solution should have \u201chigh write performance like that of DynamoDB, high data analysis performance like that of Amazon Redshift, and high compatibility with MySQL\u201d.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"The_Solution_Consolidate_Databases_with_TiDB_Dedicated\"><\/span>The Solution: Consolidate Databases with TiDB Dedicated<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Micoworks evaluated several database solutions before choosing <a href=\"https:\/\/www.pingcap.com\/ko\/tidb-dedicated\/\">TiDB Dedicated<\/a>, a fully-managed cloud DBaaS offering of TiDB for predictable workloads. TiDB Dedicated has several features that make it well-suited for Micoworks:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>MySQL compatibility:<\/strong> By being wire compatible with MySQL, TiDB Dedicated allows the company to leverage MySQL\u2019s rich ecosystem of tools and frameworks without having to learn anything new.&nbsp;<\/li>\n\n\n\n<li><strong>Horizontal scalability<\/strong>: TiDB Dedicated can be scaled horizontally to handle increasing data volumes and workloads.<\/li>\n\n\n\n<li><strong>Strong consistency<\/strong>: TiDB Dedicated provides strong consistency for all reads and writes, which is important for data analysis.<\/li>\n\n\n\n<li><strong>Mixed workload processing<\/strong>: By incorporating TiFlash, a columnar data store, TiDB Dedicated delivers both transaction processing and high-speed data analytics within a single database system.&nbsp;<\/li>\n\n\n\n<li><strong>Fully-managed service<\/strong>: TiDB Dedicated is available with stable operation and solid support from PingCAP, the company behind TiDB.&nbsp;&nbsp;<\/li>\n<\/ul>\n\n\n\n<p>After extensive testing, TiDB Dedicated met all of Micoworks&#8217; criteria for write performance, data analysis, and MySQL compatibility. Micoworks migrated to TiDB Dedicated successfully in a single month.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"960\" height=\"540\" src=\"https:\/\/static.pingcap.com\/files\/2023\/10\/10030140\/image.png\" alt=\"Database Consolidation: Replacing DynamoDB and Amazon Redshift with TiDB\" class=\"wp-image-14173\" srcset=\"https:\/\/static.pingcap.com\/files\/2023\/10\/10030140\/image.png 960w, https:\/\/static.pingcap.com\/files\/2023\/10\/10030140\/image-300x169.png 300w, https:\/\/static.pingcap.com\/files\/2023\/10\/10030140\/image-768x432.png 768w\" sizes=\"auto, (max-width: 960px) 100vw, 960px\" \/><\/figure>\n\n\n\n<p class=\"has-text-align-center\"><em>Figure 2: MicoCloud&#8217;s Architecture after TiDB<\/em><\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"The_Results\"><\/span>The Results<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>Since migrating to TiDB Dedicated, Micoworks has experienced several tangible benefits to its business:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Reduced operational complexity<\/strong>: With DynamoDB and Amazon RedShift consolidated by TiDB Dedicated, Micoworks now has a much simpler database to manage. Using the managed service simplifies their operations even more.<\/li>\n\n\n\n<li><strong>Improved analytics performance<\/strong>: TiDB Dedicated has significantly improved the performance of Micoworks&#8217; analytics workloads. The query latency times have gone from one minute down to one second.&nbsp;<\/li>\n\n\n\n<li><strong>Reduced costs<\/strong>: TiDB Dedicated has reduced the number of database instances Micoworks pays for each month.<\/li>\n<\/ul>\n\n\n\n<p>The migration to TiDB Dedicated solved major complexity and performance issues for&nbsp;Micoworks. &#8220;As MicoCloud aspires to be the leading product in conversational commerce across Asia, we need a database that is scalable, real-time, and cost-effective,&#8221; Mr. Awashima, the product manager of MicoCloud, noted, \u201cTiDB\u2019s flexible, high-performance architecture seems to be just the solution that Micoworks needed for their ambitious plans\u201d.<\/p>","protected":false},"excerpt":{"rendered":"<p>In today&#8217;s data-driven world, databases serve as the backbone for not just recording and analyzing business data, but also for accumulating diverse data sets such as customer interactions and social media metrics for effective engagement with customers.&nbsp; Micoworks is the Japanese company behind MicoCloud, an SNS communication platform that helps businesses engage with their customers. [&hellip;]<\/p>\n","protected":false},"author":8,"featured_media":17221,"template":"","tags":[229,10,31],"customer":[228],"industry":[183],"class_list":["post-14172","case-study","type-case-study","status-publish","has-post-thumbnail","hentry","tag-database-consolidation","tag-htap","tag-tidb-cloud","customer-micoworks","industry-saas"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Database Consolidation: How Micoworks Migrated to TiDB<\/title>\n<meta name=\"description\" content=\"Learn how Micoworks streamlined their large-scale data operations through database consolidation of DynamoDB and Amazon Redshift with TiDB.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.pingcap.com\/ko\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/\" \/>\n<meta property=\"og:locale\" content=\"ko_KR\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Database Consolidation: How Micoworks Migrated to TiDB\" \/>\n<meta property=\"og:description\" content=\"Learn how Micoworks streamlined their large-scale data operations through database consolidation of DynamoDB and Amazon Redshift with TiDB.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.pingcap.com\/ko\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/\" \/>\n<meta property=\"og:site_name\" content=\"TiDB\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/facebook.com\/pingcap2015\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-31T06:18:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1500\" \/>\n\t<meta property=\"og:image:height\" content=\"500\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@PingCAP\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3\ubd84\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/\",\"url\":\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/\",\"name\":\"Database Consolidation: How Micoworks Migrated to TiDB\",\"isPartOf\":{\"@id\":\"https:\/\/www.pingcap.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg\",\"datePublished\":\"2023-10-11T02:42:47+00:00\",\"dateModified\":\"2024-05-31T06:18:54+00:00\",\"description\":\"Learn how Micoworks streamlined their large-scale data operations through database consolidation of DynamoDB and Amazon Redshift with TiDB.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#breadcrumb\"},\"inLanguage\":\"ko-KR\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"ko-KR\",\"@id\":\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#primaryimage\",\"url\":\"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg\",\"contentUrl\":\"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg\",\"width\":1500,\"height\":500,\"caption\":\"Micoworks\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.pingcap.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Case Studies\",\"item\":\"https:\/\/www.pingcap.com\/customers\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"How Micoworks Consolidated Amazon DynamoDB and Redshift Workloads with TiDB\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.pingcap.com\/#website\",\"url\":\"https:\/\/www.pingcap.com\/\",\"name\":\"TiDB\",\"description\":\"TiDB | SQL at Scale\",\"publisher\":{\"@id\":\"https:\/\/www.pingcap.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.pingcap.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"ko-KR\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.pingcap.com\/#organization\",\"name\":\"PingCAP\",\"url\":\"https:\/\/www.pingcap.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"ko-KR\",\"@id\":\"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png\",\"contentUrl\":\"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png\",\"width\":811,\"height\":232,\"caption\":\"PingCAP\"},\"image\":{\"@id\":\"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/facebook.com\/pingcap2015\",\"https:\/\/x.com\/PingCAP\",\"https:\/\/linkedin.com\/company\/pingcap\",\"https:\/\/youtube.com\/channel\/UCuq4puT32DzHKT5rU1IZpIA\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Database Consolidation: How Micoworks Migrated to TiDB","description":"Learn how Micoworks streamlined their large-scale data operations through database consolidation of DynamoDB and Amazon Redshift with TiDB.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.pingcap.com\/ko\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/","og_locale":"ko_KR","og_type":"article","og_title":"Database Consolidation: How Micoworks Migrated to TiDB","og_description":"Learn how Micoworks streamlined their large-scale data operations through database consolidation of DynamoDB and Amazon Redshift with TiDB.","og_url":"https:\/\/www.pingcap.com\/ko\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/","og_site_name":"TiDB","article_publisher":"https:\/\/facebook.com\/pingcap2015","article_modified_time":"2024-05-31T06:18:54+00:00","og_image":[{"width":1500,"height":500,"url":"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_site":"@PingCAP","twitter_misc":{"Est. reading time":"3\ubd84"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/","url":"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/","name":"Database Consolidation: How Micoworks Migrated to TiDB","isPartOf":{"@id":"https:\/\/www.pingcap.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#primaryimage"},"image":{"@id":"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#primaryimage"},"thumbnailUrl":"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg","datePublished":"2023-10-11T02:42:47+00:00","dateModified":"2024-05-31T06:18:54+00:00","description":"Learn how Micoworks streamlined their large-scale data operations through database consolidation of DynamoDB and Amazon Redshift with TiDB.","breadcrumb":{"@id":"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#breadcrumb"},"inLanguage":"ko-KR","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/"]}]},{"@type":"ImageObject","inLanguage":"ko-KR","@id":"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#primaryimage","url":"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg","contentUrl":"https:\/\/static.pingcap.com\/files\/2024\/05\/27003946\/Micoworks.jpg","width":1500,"height":500,"caption":"Micoworks"},{"@type":"BreadcrumbList","@id":"https:\/\/www.pingcap.com\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.pingcap.com\/"},{"@type":"ListItem","position":2,"name":"Case Studies","item":"https:\/\/www.pingcap.com\/customers\/"},{"@type":"ListItem","position":3,"name":"How Micoworks Consolidated Amazon DynamoDB and Redshift Workloads with TiDB"}]},{"@type":"WebSite","@id":"https:\/\/www.pingcap.com\/#website","url":"https:\/\/www.pingcap.com\/","name":"\ud2f0DB","description":"TiDB | SQL at Scale","publisher":{"@id":"https:\/\/www.pingcap.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.pingcap.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"ko-KR"},{"@type":"Organization","@id":"https:\/\/www.pingcap.com\/#organization","name":"PingCAP","url":"https:\/\/www.pingcap.com\/","logo":{"@type":"ImageObject","inLanguage":"ko-KR","@id":"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/","url":"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png","contentUrl":"https:\/\/static.pingcap.com\/files\/2021\/11\/pingcap-logo.png","width":811,"height":232,"caption":"PingCAP"},"image":{"@id":"https:\/\/www.pingcap.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/facebook.com\/pingcap2015","https:\/\/x.com\/PingCAP","https:\/\/linkedin.com\/company\/pingcap","https:\/\/youtube.com\/channel\/UCuq4puT32DzHKT5rU1IZpIA"]}]}},"card_markup":"<div class=\"card-case-study\"><div class=\"card-case-study__image-container\"><img class=\"card-case-study__image\" alt=\"Micoworks\" src=\"https:\/\/static.pingcap.com\/files\/2023\/12\/14203544\/Micoworks.svg\" loading=\"lazy\" \/><\/div><span class=\"card-case-study__title\">How Micoworks Consolidated Amazon DynamoDB and Redshift Workloads with TiDB<\/span><div class=\"card-case-study__button\"><a class=\"button--secondary\" href=\"https:\/\/www.pingcap.com\/ko\/case-study\/database-consolidation-dynamodb-amazon-redshift-tidb\/\" target=\"_blank\">View Case Study<\/a><\/div><\/div>","_links":{"self":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/case-study\/14172","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/case-study"}],"about":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/types\/case-study"}],"author":[{"embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/users\/8"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/media\/17221"}],"wp:attachment":[{"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/media?parent=14172"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/tags?post=14172"},{"taxonomy":"customer","embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/customer?post=14172"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.pingcap.com\/ko\/wp-json\/wp\/v2\/industry?post=14172"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}