Microsoft Fabric Data/Analytics Engineer

Replacement for expired DP 203 Data Engineering on Microsoft Azure (Microsoft Certified: Azure Engineer Associate)

This course prepares you for the:
DP 700 Microsoft Data Engineer Associate Certification & DP 600 Microsoft Data Analytics Associate Certification

Duration: 5 Days

Overview

This course covers methods and practices to implement data engineering solutions by using Microsoft Fabric. Students will learn how to design and develop effective data loading patterns, data architectures, and orchestration processes. Objectives for this course include ingesting and transforming data and securing, managing, and monitoring data engineering solutions. This course is designed for experienced data professionals skilled at data integration and orchestration.

Audience Profile

This audience for this course is data professionals with experience in data analytics, extraction, transformation, and loading.  Learners should also have experience at manipulating and transforming data with one of the following programming languages: Structured Query Language (SQL), PySpark, or Kusto Query Language (KQL).

Recommended Prerequisites

Structured Querying Language

• Query and Modify Data with Transact-SQL
• SQL for Data Analysis

Programming

• Introduction to Programming with Python
• Using Data Science Tools in Python

Learning Objectives

Ingest data with Microsoft Fabric

• Ingest Data with Dataflows Gen2 in Microsoft Fabric - Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows for visually creating multi-step data ingestion and transformation using Power Query Online.
• Orchestrate processes and data movement with Microsoft Fabric - Microsoft Fabric includes Data Factory capabilities, including the ability to create pipelines that orchestrate data ingestion and transformation tasks.
• Use Apache Spark in Microsoft Fabric - Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale.
• Work with real-time data in a Microsoft Fabric eventhouse - An eventhouse in Microsoft Fabric provides a scalable and flexible store for real-time data.

Implement a Lakehouse with Microsoft Fabric

• Introduction to end-to-end analytics using Microsoft Fabric - Discover how Microsoft Fabric can meet your enterprise's analytics needs in one platform. Learn about Microsoft Fabric, how it works, and identify how you can use it for your analytics needs.
• Get started with lakehouses in Microsoft Fabric - Lakehouses merge data lake storage flexibility with data warehouse analytics. Microsoft Fabric offers a lakehouse solution for comprehensive analytics on a single SaaS platform.
• Use Apache Spark in Microsoft Fabric - Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale.
• Work with Delta Lake tables in Microsoft Fabric - Tables in a Microsoft Fabric lakehouse are based on the Delta Lake storage format commonly used in Apache Spark. By using the enhanced capabilities of delta tables, you can create advanced analytics solutions.
• Ingest Data with Dataflows Gen2 in Microsoft Fabric - Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows for visually creating multi-step data ingestion and transformation using Power Query Online
• Orchestrate processes and data movement with Microsoft Fabric - Microsoft Fabric includes Data Factory capabilities, including the ability to create pipelines that orchestrate data ingestion and transformation tasks.
• Organize a Fabric lakehouse using medallion architecture design - Explore the potential of the medallion architecture design in Microsoft Fabric. Organize and transform your data across Bronze, Silver, and Gold layers of a lakehouse for optimized analytics.

Implement Real-Time Intelligence with Microsoft Fabric

• Get started with Real-Time Intelligence in Microsoft Fabric - Real-Time Intelligence in Microsoft Fabric helps you ingest, process, store, visualize, and act on data in motion to get insights from events as they happen.
• Use real-time eventstreams in Microsoft Fabric - Microsoft Fabric Eventstreams within Real-Time Intelligence (RTI) enable you to ingest and transform real-time data.
• Work with real-time data in a Microsoft Fabric eventhouse - An eventhouse in Microsoft Fabric provides a scalable and flexible store for real-time data.
• Create Real-Time Dashboards with Microsoft Fabric - Real-time Dashboard is a Real-Time Intelligence capability in Microsoft Fabric that you can use to create real-time data visualizations.

Implement a data warehouse with Microsoft Fabric

• Introduction to end-to-end analytics using Microsoft Fabric - Discover how Microsoft Fabric can meet your enterprise's analytics needs in one platform. Learn about Microsoft Fabric, how it works, and identify how you can use it for your analytics needs.
• Get started with data warehouses in Microsoft Fabric - Data warehouses are analytical stores built on a relational schema to support SQL queries. Microsoft Fabric enables you to create a relational data warehouse in your workspace and integrate it easily with other elements of your end-to-end analytics solution.
• Load data into a Microsoft Fabric data warehouse - Data warehouse in Microsoft Fabric is a comprehensive platform for data and analytics, featuring advanced query processing and full transactional T-SQL capabilities for easy data management and analysis.
• Query a data warehouse in Microsoft Fabric - Data warehouse in Microsoft Fabric is a comprehensive platform for data and analytics, featuring advanced query processing and full transactional T-SQL capabilities for easy data management and analysis.
• Monitor a Microsoft Fabric data warehouse - A data warehouse is a vital component of an enterprise analytics solution. It's important to learn how to monitor a data warehouse so you can better understand the activity that occurs in it.
• Secure a Microsoft Fabric data warehouse - Data warehouse in Microsoft Fabric is a comprehensive platform for data and analytics, featuring advanced query processing and full transactional T-SQL capabilities for easy data management and analysis.

Manage a Microsoft Fabric environment

• Implement continuous integration and continuous delivery (CI/CD) in Microsoft Fabric - Microsoft Fabric implements CI/CD using Git integration and deployment pipelines. These tools help you collaborate with your development team and provide you with an efficient process for delivering and updating content.
• Monitor activities in Microsoft Fabric - Monitoring helps you gain visibility into the health of your data systems. Monitoring Hub in Microsoft Fabric collects and aggregates data from Fabric activities. Microsoft Fabric Activator helps you take actions when patterns or conditions are detected in streaming data.
• Secure data access in Microsoft Fabric - Microsoft Fabric uses a multi-layer security model with access controls at different levels.
• Administer a Microsoft Fabric environment - Microsoft Fabric is a SaaS solution for end-to-end data analytics. As an administrator, you can configure features and manage access to suit your organization's needs.

Work with semantic models in Microsoft Fabric

• Create Dax Calculations in Semantic Models - Adding DAX calculations to Power BI semantic models allows you to define custom logic within your data model, to enable deeper analysis and data-driven business decisions.
• Design Scalable Models - Good modeling practices lead to scalable semantic models that simplify analysis and reporting of large, complex data, enhancing Power BI reports for an optimal user experience.
• Optimize a Model for Performance in Power BI - Performance optimization, also known as performance tuning, involves making changes to the current state of the semantic model so that it runs more efficiently. Essentially, when your semantic model is optimized, it performs better.
• Create and Manage Power BI Assets - Create Power BI assets for your analytics environment for structure and consistency, such as Power BI template and project files. Reusable assets and using the XMLA endpoint support application lifecycle management, including continuous integration and deployment.
• Enforce Power BI Model Security - Enforce model security in Power BI using row-level security and object-level security.