Microsoft Certified: Fabric Analytics Engineer AssociatePrepare and transform data (20-25%)Easy
A data engineer is working on a project to consolidate customer data from various regional databases into a central Lakehouse in Microsoft Fabric. Each regional database has slightly different schema variations (e.g., 'Cust_ID' vs 'CustomerID', 'First Name' vs 'FName'). The engineer needs to standardize these column names and data types, combine the datasets, and ensure data quality by removing duplicate records based on a unique identifier. Which feature within Dataflows Gen2 is primarily used for these types of schema and data quality transformations?
- AScheduled refresh options
- BData destination settings
- CSource settings in the connector configuration
- DPower Query Editor
Show answer & explanationAnswer & explanation
Correct answer: D. Power Query Editor
The Power Query Editor within Dataflows Gen2 provides a rich graphical interface to perform data transformation tasks, including renaming columns, changing data types, merging queries, and removing duplicates.
Why the other options are wrong
- A. Scheduled refresh options control when the dataflow runs, not how the data is transformed.
- B. Data destination settings define where the transformed data will be loaded and in what format, not the transformations themselves.
- C. Source settings are for establishing the connection and initial data retrieval, not for detailed transformations.
Power Query Editor
A visual data transformation tool integrated into Dataflows Gen2 and other Microsoft products, enabling users to clean, shape, and combine data.
- Uses a M language behind the scenes.
- Provides a wide array of transformation functions.
- Records steps for reproducibility.
Memory trick: Power Query: The artist's studio for data shaping.