{"id":13006,"date":"2023-07-21T12:15:21","date_gmt":"2023-07-21T19:15:21","guid":{"rendered":"https:\/\/www.pingcap.com\/?p=13006"},"modified":"2025-11-14T06:56:57","modified_gmt":"2025-11-14T14:56:57","slug":"how-data-engineering-powers-pinterest-global-platform","status":"publish","type":"post","link":"https:\/\/www.pingcap.com\/ko\/blog\/how-data-engineering-powers-pinterest-global-platform\/","title":{"rendered":"How Data Engineering is Powering Pinterest’s Global Platform"},"content":{"rendered":"

The following post is an excerpt from Technology Magazine\u2019s feature article, How data engineering is powering Pinterest\u2019s global platform<\/strong><\/a>.<\/em><\/p>\n\n\n\n

Pinterest had long recognized the need to streamline and optimize its data storage system.<\/p>\n\n\n\n

Using HBase, the image sharing and social media platform was carrying a large footprint, with more than 50 clusters and a total data size of no less than one petabyte (PB). <\/p>\n\n\n\n

That\u2019s where PingCAP came in.<\/p>\n\n\n\n

PingCAP launched in 2015 when three seasoned data infrastructure engineers grew tired with the way databases scaled while working at leading tech companies.<\/p>\n\n\n\n

Seeing no capable solutions on the market, they built one from scratch themselves.<\/p>\n\n\n\n

\ud2f0DB<\/a>, their flagship project, is an advanced, open-source distributed SQL database for powering modern applications<\/a> with elastic scaling, real-time analytics<\/a> and continuous access to data. Under the hood, it can be used for large-scale applications reaching several-hundred terabytes.\u00a0<\/p>\n\n\n\n

What was Pinterest’s data engineering team trying to achieve?<\/h2>\n\n\n\n

The objective for Pinterest was to try and address the limitations of its existing HBase system, which was mainly being used for user-facing applications.<\/p>\n\n\n\n

\u201cWhat Pinterest\u2019s storage and caching team wanted was to find their next-generation, unifying storage system,\u201d explains Liquan Pei, Principal Technologist at PingCAP. \u201cAs a NoSQL database, HBase offers a very simple key value interface, but the business logistics are complex. <\/p>\n\n\n\n

\u201cWhen Pinterest wanted to add some new features, they had to constantly build additional layers on top of HBase, just to try and avoid its limitations. Multiple components make up this system, which incurs a very high maintenance workload.\u201d<\/p>\n\n\n\n<\/br>\n

\n