S3 比文件系统更快吗?
One of the most interesting things that used to happen to me when I was working at AWS was hearing from customers who told me that they "preferred to use S3 because it was faster than EFS". This was really funny to me because it's untrue, but it's also the experience of so many developers. Why is this.
当我在 AWS 工作时,最有趣的事情之一是听到客户告诉我他们 "preferred to use S3 because it was faster than EFS"。这对我来说真的很搞笑,因为这是不真实的,但这也是这么多开发者的体验。为什么会这样。
It's first important to define what we mean when we talk about "speed" of storage solutions. Storage solutions define their speed in two different axes: latency and throughput. "Latency" is the time that it takes for an individual operation to complete, and "throughput" is the number of operations (measured in either count or bytes transferred) that can complete on a system within a given second.
首先重要的是定义我们谈论存储解决方案的「speed」时所指的是什么。存储解决方案在两个不同的维度上定义它们的速度:latency 和 throughput。「Latency」是单个操作完成所需的时间,「throughput」是系统在一秒钟内能够完成的操作数量(以计数或传输字节数衡量)。
Users, however, measure speed a different, much simpler, way. They run <SOMETHING> (this will differ per user) and measure the wall-clock time of that thing to actually complete.
然而,用户以一种不同的、简单得多的方式来衡量速度。他们运行 <SOMETHING>(这因用户而异),并测量该事物实际完成所需的墙钟时间。
This is the truth of all products, you can work night and day on features and benchmarks, but your customers *do not care*. They just want the thing that they are trying to build to work well.
这是所有产品的真相,你可以夜以继日地开发功能和基准测试,但你的客户 *do not care*。他们只想要他们试图构建的东西能正常工作。
Last week, we talked about how S3 is [speculated] to be hard-drive based storage and EFS (now, S3 Files) is [speculated] to be SSD-based storage. As a result, the *cost* of EFS is much higher (>10x), but the raw latency to access data on EFS is much faster.
上周,我们讨论了 S3 被 [speculated] 是基于硬盘的存储,而 EFS(现在是 S3 Files)被 [speculated] 是基于 SSD 的存储。因此,EFS 的 *成本* 高得多(>10x),但在 EFS 上访问数据的原始 latency 要快得多。
Now, I'm a storage engineer, so for me "speed" immediately translates to latency. Let's look at a latency diagram (and I'm sorry, but these will not be to scale today):
现在,...