#79: Break Into Amazon S3 Architecture (4 Minutes)
What about data consistency? The blog I felt is more about metadata consistency
I think S3 has taken some inspiration from the Amazon Dynamo whitepaper.
Here are some techniques:
- Quorum reads & writes
- Vector clocks & conflict resolution
- Replication control
Amazon S3 powers so many companies and businesses. It's really powerful.
Solid breakdown, Neo!
Nice to learn something...
So many critical services rely on S3 behind the scenes, even a small hiccup can ripple across everything.
Thanks for the breakdown, Neo.
indeed, you're welcome + thanks!
I see, what alternatives do you suggest?
Google offer 99.95% https://cloud.google.com/storage/sla.
Amazon - offer on durability 99.999999999% (until 11 nines) https://aws.amazon.com/s3/storage-classes/#topic-0
Without saying that each nines that you wan't to achieve is a 10x more investment.
I'm not saying that is ok amazon/google offer 99.99% they need to do more. For the other side each nine will cost you 10X of investment.
What about data consistency? The blog I felt is more about metadata consistency
I think S3 has taken some inspiration from the Amazon Dynamo whitepaper.
Here are some techniques:
- Quorum reads & writes
- Vector clocks & conflict resolution
- Replication control
Amazon S3 powers so many companies and businesses. It's really powerful.
Solid breakdown, Neo!
Nice to learn something...
So many critical services rely on S3 behind the scenes, even a small hiccup can ripple across everything.
Thanks for the breakdown, Neo.
indeed, you're welcome + thanks!
I see, what alternatives do you suggest?
Google offer 99.95% https://cloud.google.com/storage/sla.
Amazon - offer on durability 99.999999999% (until 11 nines) https://aws.amazon.com/s3/storage-classes/#topic-0
Without saying that each nines that you wan't to achieve is a 10x more investment.
I'm not saying that is ok amazon/google offer 99.99% they need to do more. For the other side each nine will cost you 10X of investment.