Microsoft Fabric: End to End Data Engineering Project

Udemy Certificate USD 19.99
Enroll now →
Microsoft Fabric: End to End Data Engineering Project

About this course

In this project,  we will build a Bing News Data Analytics platform! This would be a complete end to end Azure Data Engineering project that's done using Microsoft Fabric. We'll pull raw data from Bing API, transform the raw data to clean data with Synapse Data Engineering, analyze sentiment with Synapse Data Science, set up workflows with Data Factory, make cool reports with Power BI, set alerts with Data Activator, and test everything well. Let's get started on Bing News Analytics!  The Topics covered in this Project are, 1. Data Ingestion from Bing API using Data Factory: Learn how to seamlessly pull in data from external sources, setting the foundation for your analytics project. 2. Data Transformation using Synapse Data Engineering: Dive into the process of shaping and refining your raw JSON data to a curated Delta Table, including techniques like incremental loading to keep your processes efficient. 3. Sentiment Analysis using Synapse Data Science: Uncover insights hidden within the news description by predicting the sentiment of the news classified as Positive, Negative or Neutral. 4. Orchestration using Data Factory via pipelines: Discover the art of orchestrating your data workflows, ensuring smooth and efficient operations. 5. Data Reporting using Power BI: Visualize your data in a compelling and actionable manner, empowering stakeholders with valuable insights. 6. Configuring Alerts using the Data Activator: Stay ahead of potential issues by setting up alerts and notifications within your Power BI visuals using a new tool called Data Activator. 7. End to End Pipeline Testing: The complete flow will be tested right from the data ingestion to the data transformation and until the report gets updated with the incoming new data to Validate the integrity and performance of your pipelines, ensuring reliability and accuracy. This project revolves around Bing New

What you'll learn

  • data ingestion from external APIs
  • data transformation techniques with Synapse Data Engineering
  • sentiment analysis classification
  • workflow orchestration using Data Factory
  • data visualization with Power BI
  • alert configuration within Power BI

Course objectives

  • build a complete data engineering pipeline from data ingestion to reporting
  • ensure integrity and performance through end-to-end testing

Skills you'll gain

Related courses

Course details are provided by the platform and may change — always confirm on the provider's site. Links may be affiliate links.