Azure Monitoring Overview – Monitoring Azure Data Storage and Processing
Azure Monitoring Overview, Exams of Microsoft, Handle Skew in Data, Microsoft DP-203, Tune Queries by Using CacheEvery Azure product has some type of built‐in monitoring capability. Most of them have alerts, metrics, diagnostics settings, and logs, which are components of Azure Monitor. This chapter provides a detailed look into those monitoring capabilities for ADLS, Azure Synapse Analytics, Azure Stream Analytics, and Azure Databricks. The following section provides a glimpse of those monitoring capabilities in some additional Azure products.
Azure Batch
Figure 9.32 shows the Metrics blade for an Azure Batch account. Notice the selected metrics of Dedicated Core Count, Job Start Events, Running Node Count, Task Start Events, and Task Complete Events.
FIGURE 9.32 The Azure Batch Metrics blade
The available categories of on the Diagnostic Settings blade are Service Logs, Audit Logs, and All Metrics. Adding a diagnostic setting to include these categories and target a Log Analytics workspace for storage enables you to query them using KQL. The metrics and logging available on this blade focus on pools, nodes, and tasks. For a deeper look at the execution details of a specific job, refer to Figure 6.9, which illustrates batch job–specific details and detailed log files like stderr.txt and stdout.txt. Additionally, Figure 6.21illustrates the Batch Explorer, which provides a useful overview of the health of your Azure Batch account, pools, nodes, tasks, and jobs.
Azure Key Vault
The same monitoring capabilities exist in Azure Key Vault as in other Azure products. Figure 9.33 shows the Metrics blade.
FIGURE 9.33 The Azure Key Vault Metrics blade
The configured metrics are Overall Service Api Latency, Total Service Api Hits, and Total Service Api Results. The latency value represents the speed at which the request for a key, secret, or certificate occurred, whereas the hits and results represent the number of requests and successful responses, respectively. Those three metrics provide a good overview of how Azure Key Vault performed over a historical timeframe. For Azure Key Vault, you see that it has the Insights blade, which gives you some extra capability to go deeper into the platform code. This is also the place where you can create workbooks, as discussed earlier in the ADLS section and shown in Figure 9.9. The Alerts, Logs, and Diagnostic Settings blades are also available for Azure Key Vault. Audit Logs, Azure Policy Evaluation Details, and All Metrics are the categories available for logging and analysis.