A Day of Azure Data Factory

SQLBits 2024 runs from Tuesday 19th – Saturday 23rd March.

Big Data & Data Engineering

A Day of Azure Data Factory

Description

In this session we provision an Azure Data Factory (ADF) and demonstrate many uses for ADF in the modern data enterprise, including:
- Editing ADF pipeline JSON
- Version control integration
- Copying data with the copy data activity
- Parameters and use cases for parameterization (dynamic property values and expressions)
- Design patterns for the hybrid data estate
- Loading data from an on-premises data source
- Survey newer activities
- Debugging and troubleshooting ADF pipelines
- Looping, iteration, and conditionals
- Monitoring
- Execution automation (triggers + )
- ADF REST API
- security required to interact with Azure Blob Storage, Azure SQL DB, REST API, integration runtimes, git, and on-premises (plus Key Vault)
- Provisioning and using integration runtimes

Learning Objectives

1. How to get started developing with ADF; how to navigate the development user experience. 2. How to monitor and administer ADF; security required for interaction with helpful Azure services. 3. General tips and tricks, design patterns, troubleshooting.

Previous Experience

Familiarity with T-SQL and data integration is helpful but not necessary.

Tech Covered

Azure, Move to the cloud, Developing, Managing, Monitoring, Big Data & Data Engineering, Data Loading Patterns & Techniques

Book now

The Agenda