One Stone, Three Birds: Finer-Grained Encryption @ Apache Parquet™

One Stone, Three Birds: Finer-Grained Encryption @ Apache Parquet™

摘要

Data access restrictions, retention, and encryption at rest are fundamental security controls. This blog explains how we have built and utilized open-sourced Apache Parquet™’s finer-grained encryption feature to support all 3 controls in a unified way. In particular, we will focus on the technical challenges of designing and applying encryption in a secure, reliable, and efficient manner. We will also share our experiences with recommended practices to manage the system in production and at scale.