S3
-
AthenaCloud/AWS 2022. 6. 17. 10:56
Overview Interactive query service for S3 (SQL) No need to load data, it stays in S3 Presto under the hood Serverless Unstructured, semi-structured, or structured Supports many data formats CSV JSON ORC Parquet Avro Examples ad-hoc queries of weblogs Querying staging data before loading to Redshift Analyze Cloudtail/CloudFront/VPC/ELB etc logs in S3 Integration with Jupiter, Zeppelin, R Studio n..
-
Choosing the right database on AWSCloud/AWS 2021. 3. 8. 17:47
1. Overview We have a lot of managed databases on AWS to choose from. 1.1 Questions to choose the right database based on your architecture: Read-heavy, write-heavy, or balanced workload? Throughput needs? Will it change? Does it need to scale or fluctuate during the day? How much data to store and for how long? Will it grow? Average object size? How are they accessed? Data durability? Source of..
-
Simple Storage Service (S3)Cloud/AWS 2020. 11. 24. 16:30
1. Overview Amazon S3 is one of the main building blocks of AWS It's advertised as "infinitely scaling" storage It's widely popular and deserves its own section Maybe websites use Amazon S3 as a backbone Many AWS services use Amazone S3 as an integration as well 2. Buckets Amazon S3 allows people to store objects (files) in "buckets" (directories) Buckets must have a globally unique name Buckets..
-
S3, Block storage, File storage, and Object storageDB/RDB 2020. 2. 24. 01:02
1. Overview 2. Object Storage 2.1 What is Object Storage The term object storage, or object-based storage, derives its name because it packages data and metadata into objects. Metadata is essentially data that describes other data, or in the case of object-based storage, is information about the files that are typically stored within an object. Objects are stored in a flat structure or address s..