Pinterest鈥檚 Content Acquisition and Media Platform is responsible for ingesting, processing, and serving all of Pinterest鈥檚 content on every surface of the application. Processing all of this content is not easy. In this post Pinterest does a deep dive into how they process visual signals from all the content on Pinterest, which then feeds into their machine learning infrastructure. Find out how they went from a Lambda Architecture to a Kappa Archicture using Hadoop, Amazon S3, Apache Thrift, Kafka, Hive, and Apache Flink.
|