==============Storage ============
**Azure Storage is a highly scalable, secure, and durable cloud storage solution provided by Microsoft Azure. At the heart of Azure Storage lies the concept of storage accounts, which serve as the foundational units for storing data in Azure. In this guide, we'll delve into the various aspects of Azure Storage Accounts, including types, key features, and differences between Standard and Premium tiers.**
Types of Azure Storage Accounts
Azure Storage offers several types of storage accounts, each optimized for specific use cases:
**General Purpose v2 (GPv2):** This is the most common type of storage account, offering a balance of performance, availability, and scalability. GPv2 supports a wide range of Azure Storage services, including Blob storage, File storage, Queue storage, and Table storage.
**General Purpose v1 (GPv1):** While still available, GPv1 accounts are being phased out in favor of GPv2 accounts. GPv1 accounts provide similar functionality to GPv2 accounts but may lack some of the latest features and performance improvements.
**Blob Storage:** Optimized for storing massive amounts of unstructured data, Blob Storage accounts are ideal for scenarios such as storing images, documents, backups, and media files. Blob Storage offers tiered storage options (Hot, Cool, and Archive) to optimize costs based on access frequency.
**File Storage:** File Storage accounts enable the creation of fully managed file shares in the cloud, accessible via the SMB (Server Message Block) protocol. They are suitable for hosting file-based workloads such as application data, user shares, and content management systems.
Key Features of Azure Storage Accounts
Azure Storage Accounts provide a range of features to meet diverse storage requirements:
**Scalability:** Storage accounts can seamlessly scale to accommodate varying workloads and data volumes, ensuring high availability and performance.
**Redundancy:** Azure Storage replicates data across multiple storage nodes within a region to ensure durability and availability. Redundancy options include locally redundant storage (LRS), zone-redundant storage (ZRS), geo-redundant storage (GRS), and geo-zone-redundant storage (GZRS).
**Security:** Storage accounts support robust security features such as encryption at rest and in transit, role-based access control (RBAC), shared access signatures (SAS), and network isolation using virtual networks and firewall rules.
**Data Lifecycle Management:** Azure Storage offers features for managing data lifecycle, including automated tiering, retention policies, and blob lifecycle management, to optimize storage costs and compliance.
**Integration:** Storage accounts seamlessly integrate with other Azure services such as Azure Virtual Machines, Azure Functions, Azure Backup, Azure Data Lake Storage, and Azure Synapse Analytics, enabling a wide range of cloud-based solutions.
**Standard vs. Premium Storage Accounts**
Azure Storage offers two primary tiers: Standard and Premium. Here's a comparison of their key characteristics:
**Performance:** Standard Storage is optimized for general-purpose workloads and offers standard performance characteristics suitable for most applications. Premium Storage, on the other hand, delivers high-performance, low-latency storage optimized for I/O-intensive workloads such as databases and virtual machine disks.
**Availability:** Both Standard and Premium Storage provide high availability with built-in redundancy. However, Premium Storage offers higher durability and availability guarantees, making it suitable for mission-critical applications requiring stringent SLAs (Service Level Agreements).
**Durability:** Premium Storage offers higher durability with an industry-leading SLA of 99.999999999% (11 nines) for locally redundant storage. Standard Storage provides a durability SLA of 99.9% for LRS and up to 99.999999999% (11 nines) for GRS.
**Price:** Premium Storage is priced higher than Standard Storage due to its enhanced performance and durability features. Organizations should carefully assess their performance and availability requirements to choose the appropriate storage tier and optimize costs.
In summary, Azure Storage Accounts are the backbone of Azure Storage, offering a flexible and scalable storage solution for diverse workloads. By understanding the types, features, and differences between Standard and Premium tiers, organizations can make informed decisions to meet their storage needs effectively while optimizing costs and performance.
**Storage Account**
- Overview: Provides a high-level summary of the storage account, including its purpose, usage, and configuration settings.
- Activity Log: Logs of activities performed on the storage account, such as resource creation, updates, and deletions, for auditing and troubleshooting purposes.
- Tags: Allows users to apply metadata tags to organize and categorize resources, facilitating management and cost allocation.
- Diagnose and Solve Problems: Tools and features for diagnosing and troubleshooting issues related to storage account performance, connectivity, and data integrity.
- Access Control (IAM): Management of access permissions and roles for users, groups, and applications accessing the storage account.
- Data Migration: Guidance and tools for migrating data into and out of the storage account, including data transfer options and best practices.
- Events: Monitoring and notification of events such as storage account changes, errors, and alerts.
- Storage Browser: Web-based interface for browsing and managing storage account contents, including blobs, files, queues, and tables.
- Storage Mover: Tools for migrating data between storage accounts, regions, and storage tiers while preserving data integrity and availability.
**Data Storage**
- Containers: Logical units for organizing and storing blobs within a storage account, providing scalability, access control, and lifecycle management.
- File Shares: Fully managed file storage solutions in the cloud, accessible via the SMB protocol, for storing and sharing files across applications and users.
- Queues: Message queues for asynchronous communication between application components, enabling reliable and scalable message processing.
- Tables: NoSQL database service for storing structured data in a schema-less format, suitable for flexible and scalable data storage and retrieval.
**Security + Networking**
- Networking: Configuration of network settings such as virtual networks, firewall rules, and private endpoints to control access to the storage account.
- Front Door and CDN: Integration with Azure Front Door and Content Delivery Network (CDN) for optimizing content delivery and performance.
- Access Keys: Primary and secondary access keys used for authenticating access to the storage account via SDKs, APIs, and tools.
- Shared Access Signature: Delegated access tokens granting limited permissions to specific resources within the storage account, valid for a defined duration.
- Encryption: Encryption options for data-at-rest and data-in-transit to protect sensitive information stored in the storage account.
- Microsoft Defender for Cloud: Advanced threat protection service for identifying and mitigating security risks and vulnerabilities in the storage account.
**Data Management**
- Storage Tasks (Preview): Automation tasks for managing storage account resources, such as provisioning, scaling, and monitoring.
- Redundancy: Configuration of data redundancy options such as locally redundant storage (LRS), geo-redundant storage (GRS), and zone-redundant storage (ZRS) to ensure data durability and availability.
- Data Protection: Backup and disaster recovery solutions for protecting data against accidental deletion, corruption, or loss.
- Object Replication: Replication of data between storage accounts and regions for data sovereignty, compliance, and high availability.
- Blob Inventory: Inventory management for tracking and analyzing blob storage usage, metadata, and access patterns.
- Static Website: Hosting of static websites directly from blob storage, enabling cost-effective and scalable web hosting solutions.
- Lifecycle Management: Automated policies for managing the lifecycle of data stored in the storage account, including tiering, deletion, and archiving.
- Azure AI Search: Integration with Azure Cognitive Search for advanced search capabilities and indexing of structured and unstructured data.
**Settings**
- Configuration: Configuration settings for storage account properties, access control, logging, and monitoring.
- Data Lake Gen2 Upgrade: Upgrade options and considerations for migrating data from Azure Data Lake Storage Gen1 to Gen2.
- Resource Sharing (CORS): Configuration of Cross-Origin Resource Sharing (CORS) rules to control access to resources from different origins.
- Advisor Recommendations: Recommendations and best practices for optimizing storage account performance, security, and cost-efficiency.
- Endpoints: Configuration of service endpoints for accessing storage account resources from within Azure Virtual Networks (VNet) or over the internet.
- Locks: Management of resource locks to prevent accidental deletion or modification of critical storage account resources.
**Monitoring**
- Insights: Insights and analytics dashboards for monitoring storage account performance, usage, and trends.
- Alerts: Configuration of alert rules and notifications for detecting and responding to storage account-related events and thresholds.
- Metrics: Collection and visualization of storage account metrics such as throughput, latency, and availability.
- Workbooks: Customizable reporting and visualization tools for creating and sharing interactive dashboards and reports.
- Diagnostic Settings: Configuration of diagnostic logs and metrics for monitoring and troubleshooting storage account activities and performance.
- Logs: Access to detailed logs and audit trails for tracking storage account activities, access requests, and system events.
- Monitoring (Classic): Legacy monitoring features and tools for tracking storage account performance, usage, and health.
- Metrics (Classic): Classic metrics collection and visualization tools for monitoring storage account performance and usage.
- Diagnostic Settings (Classic): Configuration of diagnostic logs and metrics for legacy storage account monitoring and troubleshooting.
- Usage (Classic): Classic usage reports and insights for analyzing storage account consumption and trends.
**Automation**
- Tasks (Preview): Preview features and capabilities for automating common storage account management tasks, such as provisioning, scaling, and maintenance.
- Export Template: Exporting Azure Resource Manager templates for storage account provisioning and configuration, enabling Infrastructure as Code (IaC) and automation workflows.
---------------------------------------Storage Accounts----------------------
Blob - Storing object and images & videso
Table - storing table data
Queue - Queues for send and receive messages
File Storage accounts - used for creating file shares
# Set the desired subscription if needed
az account set --subscription 0009139d-057c-4b91-be0d-f26b3b5b39dc
# Define variables
resourceGroupName="cloudshellprovisioncd"
location="eastus"
storageAccountName="cloudshellbkt"
# Create a resource group
az group create --name $resourceGroupName --location $location
# Create a storage account within the resource group
az storage account create --name $storageAccountName --resource-group $resourceGroupName --location $location --sku Standard_LRS
Upload object on storage account:
az storage container create --account-name $storageAccountName --name container1
az storage blob upload --account-name $storageAccountName --container-name container1 --file path_of_location --name blob1
Sample output:
Finished[#############################################################] 100.0000%
{
"client_request_id": "68538a78-0ba9-11ef-bcd7-00155d836002",
"content_md5": "154zLVelwWgb4GS3Wacabw==",
"date": "2024-05-06T13:06:10+00:00",
"encryption_key_sha256": null,
"encryption_scope": null,
"etag": "\"0x8DC6DCD4CF6D3DA\"",
"lastModified": "2024-05-06T13:06:10+00:00",
"request_id": "fb9e04f7-901e-0003-21b6-9fa369000000",
"request_server_encrypted": true,
"version": "2022-11-02",
"version_id": null
}
| Tier | Description | Use Cases |
|---|
| Hot Access Tier | Ideal for frequently accessed data. | Frequently accessed data, low-latency requirements. |
| Cool Access Tier | Designed for data with less frequent access. | Data with infrequent access but requires quick access when needed. |
| Archive Access Tier | Intended for data that is rarely accessed and stored for long-term retention. | Compliance data, backups, long-term archives with minimal access requirements |
By default the access tier is HOT
# Change the access tier of a blob to Hot
az storage blob set-tier --account-name <storage_account_name> --container-name <container_name> --name <blob_name> --tier Hot
# Change the access tier of a blob to Cool
az storage blob set-tier --account-name <storage_account_name> --container-name <container_name> --name <blob_name> --tier Cool
# Change the access tier of a blob to Archive
az storage blob set-tier --account-name <storage_account_name> --container-name <container_name> --name <blob_name> --tier Archive
Feature | Azure Blob Storage | Azure File Share Service |
----------------------|--------------------------|--------------------------|
Data Structure | Unstructured data | Managed file share |
Access Method | RESTful HTTP APIs | SMB protocol |
Performance | High throughput | Shared file storage |
Use Cases | Images, documents | User data, application data |
Access Control | Shared access signatures | NTFS permissions |
Cost | Pay-as-you-go | Pay-as-you-go |
Replication | Redundancy options | Redundancy options |
Integration | Integrates with services | Can be mounted as network drive |
Performance Tiers | Hot, Cool, Archive | Standard performance |
To connect a file share in linux machines
Table service for : no sql database it follows no schema based design
0 Comments