PolyBase can parallelize the process for large datasets. The data is cleansed and transformed during this process.

Data Factory incrementally loads the data from Blob storage into staging tables in Azure Synapse Analytics.

For each data source, any updates are exported periodically into a staging area in Azure Blob storage.

The data flows through the solution as follows:

Use semantic modeling and powerful visualization tools for simpler data analysis.ĭownload a Visio file of this architecture.

Integrate relational data sources with other unstructured datasets.

Establish a data warehouse to be a single source of truth for your data.

Greatly reducing the time needed to gather and transform data, so you can focus on analyzing the data.

Loading data using a highly parallelized approach that can support thousands of incentive programs, without the high costs of deploying and maintaining on-premises infrastructure.Transforming source data into a common taxonomy and structure, to make the data consistent and easily compared.Combining different kinds of data sources into a cloud-scale platform.The company needs a modern approach to analysis data, so that decisions are made using the right data at the right time. Data is fundamental to these programs, and the company wants to improve the insights gained through data analytics using Azure. These programs reward customers, suppliers, salespeople, and employees. This example demonstrates a sales and marketing company that creates incentive programs. This specific scenario is based on a sales and marketing solution, but the design patterns are relevant for many industries requiring advanced analytics of large datasets such as e-commerce, retail, and healthcare. This example scenario demonstrates a data pipeline that integrates large amounts of data from multiple sources into a unified analytics platform in Azure.

Microsoft web tools for data analysis