The Agenda

Agenda Home
SQLBits 2024 runs from Tuesday 19th – Saturday 23rd March.
Data Integrator

Azure Data Integration Pipelines - Advanced Design and Delivery

Description

In this full day training data session, we'll quickly cover the fundamentals of data integration pipelines before going much deeper into our Azure resources. Within a typical Azure data platform solution for any enterprise grade data analytics or data science workload an umbrella resource is needed to trigger, monitor, and handle the control flow for transforming datasets, with the goal being actionable data insight. Those requirements are met by deploying Azure Data Integration pipelines, delivered using Azure Synapse Analytics or Azure Data Factory. In this session, I'll show you how to create rich dynamic data pipelines and apply these orchestration resources in production. Using scaled architecture design patterns, best practice, data mesh principals, and the latest metadata driven frameworks. We will take a deep dive into the services, considering how to build custom activities, complex pipelines and think about hierarchical design patterns for enterprise grade deployments. All this and more in a complete set of 12 modules (based on real world experience) we will take you through how to implement data integration pipelines in production and deliver advanced orchestration patterns.

Feedback link https://sqlb.it/?7155

Learning Objectives

Previous Experience

Tech Covered

Azure, security, Synapse Analytics, Testing, Data transformation and integration, Data Integrator, Developing, Managing, Monitoring, Optimising, Successful Delivery