To effectively use the massively parallel processing (MPP) architecture with a SQL pool, you need to understand table geometries. Table geometries specify how data is sharded into distributions on your existing compute nodes. These table…
Anyone who has worked with computers, even for a short amount of time, knows that unexpected events happen. You can track this down all the way to the 3.3V of electricity required to flip a…
This chapter covered the sources of data and the volume, variety, and velocity of ingestion. Azure Synapse Analytics contains ample features to manage the ingestion at Big Data scale. If you currently either have an…
The ISFIRST analytic function returns a 1 if the event is the first event in the stream for the defined interval; otherwise, it returns 0. The implementation of the tumbling window function is performed as…
The example of combining multiple data files into a single table for analysis in Exercise 3.15 simply appended one file onto the next. This required you to remove and re‐create the table. Instead of dropping…
Streaming, batching, and querying data are all very performant and reliable activities when using delta tables. This means if your data analytics solution requires streaming or batching, the approach for ingesting, transforming, and serving is…
It is possible to create an additional policy with fewer rights. The RootManageSharedAccessKey policy has full access. You might consider creating a policy with the minimum access necessary, perhaps Send Only. It depends on your…
The word topology is common in IT. The concept is often experienced in the context of a network topology. It is simply the arrangement of interrelated parts that constitute the whole. The same definition can…
Figure 3.75 shows how data is ingested into Azure Databricks. There are numerous ways to ingest data, including by streaming via Event Hubs, Stream Analytics, or Kafka, or by copying data from a remote source…
The Users page provides a list of users who have access to the workspace. The role and permissions of each user are rendered as well. Table 3.18 describes the permissions (i.e., entitlements). TABLE 3.18 Azure…