# AWS Cloud Storage Services and Solutions
## 1. Amazon S3 (Simple Storage Service)
### Storage Classes
1. S3 Standard
- High availability (99.99%)
- Low latency
- Frequent access
- Use cases:
* Web hosting
* Content distribution
* Data analytics
- Pricing: Higher storage cost, lower access cost
2. S3 Intelligent-Tiering
- Automatic cost optimization
- Moving objects between access tiers
- Two access tiers:
* Frequent access
* Infrequent access
- Monitoring and automation cost per object
3. S3 Standard-IA (Infrequent Access)
- Lower storage cost
- Higher retrieval cost
- Minimum storage duration: 30 days
- Use cases:
* Backup data
* Disaster recovery
* Long-term storage
4. S3 One Zone-IA
- Single AZ storage
- Lower cost than Standard-IA
- Less availability (99.5%)
- Use cases:
* Secondary backup copies
* Easily reproducible data
5. S3 Glacier
- Long-term archival storage
- Retrieval times:
* Expedited (1-5 minutes)
* Standard (3-5 hours)
* Bulk (5-12 hours)
- Minimum storage duration: 90 days
6. S3 Glacier Deep Archive
- Lowest cost storage
- Retrieval time: 12+ hours
- Minimum storage duration: 180 days
- Use cases:
* Long-term data archival
* Regulatory compliance
### S3 Features
1. Versioning
```json
{
"VersioningConfiguration": {
"Status": "Enabled"
}
}
```
- Preserves multiple variants
- Protects against deletions
- Recovery capability
2. Lifecycle Management
```json
{
"Rules": [
{
"ID": "MoveToGlacier",
"Status": "Enabled",
"Transition": {
"Days": 90,
"StorageClass": "GLACIER"
}
}
]
}
```
- Automatic transitions
- Cost optimization
- Data retention policies
3. Encryption
- Server-side encryption (SSE):
* SSE-S3 (AWS managed keys)
* SSE-KMS (AWS KMS keys)
* SSE-C (Customer provided keys)
- Client-side encryption
## 2. Amazon EBS (Elastic Block Store)
### Volume Types
1. General Purpose SSD (gp2/gp3)
- Balanced price/performance
- Up to 16,000 IOPS
- Use cases:
* Development environments
* Virtual desktops
* Medium-sized databases
2. Provisioned IOPS SSD (io1/io2)
- High-performance
- Up to 64,000 IOPS
- Use cases:
* Critical business applications
* Large databases
* Latency-sensitive workloads
3. Throughput Optimized HDD (st1)
- Low-cost HDD
- Throughput of 500 MiB/s
- Use cases:
* Big data
* Data warehouses
* Log processing
4. Cold HDD (sc1)
- Lowest cost
- Infrequently accessed data
- Use cases:
* File servers
* Backup storage
* Archival data
### EBS Features
1. Snapshots
- Point-in-time copies
- Incremental backups
- Cross-region copying
```bash
aws ec2 create-snapshot \
--volume-id vol-1234567890abcdef0 \
--description "Daily backup"
```
2. Encryption
- AES-256 encryption
- AWS KMS integration
- No performance impact
## 3. Amazon EFS (Elastic File System)
### Storage Classes
1. Standard
- High availability
- Higher cost
- Use cases:
* Web serving
* Content management
* Application development
2. Infrequent Access
- Lower storage cost
- Higher retrieval cost
- Automatic lifecycle management
### EFS Features
1. Performance Modes
- General Purpose
* Low latency
* Default mode
- Max I/O
* Higher latency
* Higher throughput
2. Throughput Modes
- Bursting
* Scales with storage size
* Credit system
- Provisioned
* Fixed throughput
* Independent of size
## 4. AWS Storage Gateway
### Types
1. File Gateway
- S3 backed file storage
- NFS/SMB interface
- Local caching
```
On-premises ↔ File Gateway ↔ Amazon S3
```
2. Volume Gateway
- iSCSI block storage
- Cached or stored modes
- EBS snapshot backup
3. Tape Gateway
- Virtual tape library
- Compatible with backup software
- Glacier integration
## 5. Best Practices & Architecture
### Data Lifecycle Management
1. Data Classification
- Hot data (frequent access)
- Warm data (infrequent access)
- Cold data (archival)
2. Automation
- S3 lifecycle policies
- AWS Lambda triggers
- CloudWatch Events
### Cost Optimization
1. Storage Class Analysis
- Usage patterns
- Access frequency
- Cost comparison
2. Lifecycle Transitions
```json
{
"Rules": [
{
"ID": "CostOptimization",
"Filter": {
"Prefix": "data/"
},
"Transitions": [
{
"Days": 30,
"StorageClass": "STANDARD_IA"
},
{
"Days": 90,
"StorageClass": "GLACIER"
}
]
}
]
}
```
### Security
1. Access Control
- IAM policies
- Bucket policies
- Access points
```json
{
"Version": "2012-10-17",
"Statement": [
{
"Effect": "Allow",
"Principal": {
"AWS": "arn:aws:iam::account-id:user/username"
},
"Action": "s3:GetObject",
"Resource": "arn:aws:s3:::bucket-name/*"
}
]
}
```
2. Encryption
- In-transit encryption
- At-rest encryption
- Key management
### Monitoring & Maintenance
1. CloudWatch Metrics
- Storage usage
- Performance metrics
- Cost allocation
2. AWS Config Rules
- Compliance monitoring
- Resource tracking
- Change management
