Now Azure Data Factory & Synapse Analytics provides Script Activity which allows to execute the DML & DDL script on data stores (SQL family, Snowflake, Oracle). To understand this activity, in this article we will have a quick demo using this Script Activity in Azure Synapse to create (DDL) table if does not exist then… Continue reading Azure Data Factory and Synapse Analytics provides Script Activity to execute DML & DDL script
Tag: Azure
Azure Data Factory and Synapse Analytics provides new tabbed layout UI to setup of Azure Integration Runtime
Now Microsoft Azure Data Factory & Synapse Analytics provides Clean & Simple new tabbed layout UI to create/edit Azure Integration Runtime. This new tabbed UI makes it easy and simple to create/edit the Azure Integration Runtime. This new UI layout is available both in Azure Data Factory and Azure Synapse. There are 3 integration runtime… Continue reading Azure Data Factory and Synapse Analytics provides new tabbed layout UI to setup of Azure Integration Runtime
Azure Data Factory data flows: ‘incremental extract’ feature allows to read only changed rows on Azure SQL DB sources
Azure Data Factory introduced new feature in data flow: ‘incremental extract’ allows to read only rows that changed (delta or incremental data) on Azure SQL DB sources using mapping data flow. Currently this feature is in Public Preview. This feature is one of the ways to the implement ‘Incremental ETL’ and ‘CDC – Change Data… Continue reading Azure Data Factory data flows: ‘incremental extract’ feature allows to read only changed rows on Azure SQL DB sources
Microsoft Azure Data Factory: Data Integration and Transformation for Warehousing and Analytics
Microsoft Azure Cloud Data Warehousing & analytics reference architecture: integrates large amounts of data from multiple sources into a Cloud Data Warehouse for analytics using Azure cloud native data services. In this reference architecture, we will use Azure Data Factory for data integration & transformation: “Azure Data Factoryis the cloud-based ETL and data integration service… Continue reading Microsoft Azure Data Factory: Data Integration and Transformation for Warehousing and Analytics
Azure-SSIS Integration Runtime (IR) is now available as Public Preview in Azure Synapse Analytics
Now thisAzure-SSIS Integration Runtime (IR)is inPublic Previewas part of Azure Synapse Analytics. In Azure Data Factory, this runtime is already GA – Generally Available. What does this mean for Azure customer? Now customer can lift and shift their existing SSIS workload to synapse by creating an Azure-SSIS IR to execute SSIS packages natively using Execute… Continue reading Azure-SSIS Integration Runtime (IR) is now available as Public Preview in Azure Synapse Analytics
Azure Data Factory Copy Activity: how to save JSON data as string in Azure Synapse Analytics SQL Pool
In this article we will have a quick demo on how to save JSON data as string in Azure Synapse Analytics SQL Pool using “Map complex values to string” feature of mapping This article will help you to solve below issue as mentioned in image: “The retrieved type of data JArray is not supported yet.… Continue reading Azure Data Factory Copy Activity: how to save JSON data as string in Azure Synapse Analytics SQL Pool
Azure Data Factory Copy Activity: Copy Hierarchical JSON data to Azure Synapse Analytics SQL Pool
In this article we will use Azure Data Factory Copy Activity to copy the JSON data from Azure Data Lake Gen 2 to Azure Synapse Analytics SQL Pool i.e. copy from Hierarchical source to tabular sink in the form of Hierarchical Structures to Relational format. When to use ADF Copy Activity & Data flow? ADF… Continue reading Azure Data Factory Copy Activity: Copy Hierarchical JSON data to Azure Synapse Analytics SQL Pool
Azure Synapse Analytics: Map Data tool Demo Step by Step
Microsoft recently announced ‘Map Data’ tool, a new feature of Azure Synapse Analytics. Update: Map Data tool in Synapse Analytics is now Generally Available as on Jul 12 2022. In this article we will demonstrate the step by step on how to use this new feature in Azure Synapse Analytics by mapping data between Azure… Continue reading Azure Synapse Analytics: Map Data tool Demo Step by Step
Azure Solutions Architect Expert Certification Redesigned: Exam AZ-305 is live now
Exam AZ-305: Designing Microsoft Azure Infrastructure Solutions is LIVE Now: Now this is Exam AZ-305 is one of prerequisite to earn Azure Solutions Architect Expert Certification. How Azure Solutions Architect Expert Certification paths has been evolved: PAST to FUTURE -How it is evolving? PAST: (AZ-300 + AZ-301) – Already retired. PRESENT: (AZ-303 + AZ-304) –… Continue reading Azure Solutions Architect Expert Certification Redesigned: Exam AZ-305 is live now
Azure Synapse Lake Database: WHY & HOW to get started?
In this article we will discuss WHY we need lake database in Azure Synapse i.e. what challenges it solves and HOW it solves these challenges and HOW to get started with lake database. Currently this Azure Synapse Lake database is in public preview. The lake database in Azure Synapse Analytics enables customers to bring together… Continue reading Azure Synapse Lake Database: WHY & HOW to get started?