Activity Dependencies with Logical AND in ADF

Introduction

In this article we are going to discuss about Activity Dependencies at ADF Control flow. As a SSIS developer we all have Experience about Precedence Constrains and how useful it is when building SSIS control flow. In ADF we have the similar concept with some limitation. Depends on this, we have to design our control flow in ADF.

Hope it will be interesting.

 

Precedence Constraints in SSIS

Before moving further, we have to review our SSIS Precedence Constraints.

 


Here we have:

1.      Constraint – Success, Failure, Completion

2.      Expression

3.      Logical AND / OR

 

It is really flexible.

 

Activity Dependency in ADF

 


 

In ADF Activity Dependencies provides only Logical AND not any Logical OR.

It has Add Activity on:

1.      Success

2.      Failure

3.      Completion

4.      Skipped

 

ADF Control Flow Wrong Design Pattern

 


 

In the above control flow design patter, the Stored Procedure Activity is not executed until The Get Meta Data Activity and ForEach Activity gives some error. As we told before that Activity Dependencies comes only with Logical AND operator. So, in this situation if both the Get Meta Data Activity and ForEach Activity Fails then the Stored Procedure Activity is Executed others Not.

 

ADF Control Flow Correct Design Pattern

To fix the above scenario, we can move into two approaches.

 

Approach-1

 


 

Approach-2

 


 

 

 

Hope you like it.


Comments

Post a Comment

Popular Posts

Using Lookup in ADF Data Flow

Image
Introduction SSIS developer, we all know the importance of Lookup Transform . Here in ADF, we have two types of Lookup. One is for control flow and other is for data flow. The behavior of both the lookup is not same. Control flow lookup provide only record sets but in Data flow we are using it as for looking up some records from other data sets. In ADF data flow Lookup feature is more than the SSIS Lookup Transform. So, in this article we are thinking to demonstrate all the functionality of ADF Data Flow lookup with a simple example.   Hope it will be interesting.   Case scenario We have a Flat file which contains Employee Code, Salary and Bonus Information. There are multiple Flat files in our Azure BLOB Container. Now we have a JSON file which contains information about Employee Code, Employee Name and Employee Email. Now we have to use the Lookup Transform to find the Employee Name and Employee Email from our JSON file.   About Data Flow Lookup Before moving to
Read more

Vertipaq Engine – Column & Segment Elimination

Image
  Introduction As we are discussing about the power of Vertipaq Engine, in this post we are going to discuss about another beautiful technique that Vertipaq Engine maintain to make our query faster and that is Column Elimination and Segment Elimination.   Hope it will be interesting. Case Study We have a table which is imported into Vertipaq engine. Table Name: Order_Details   Column Elimination As Vertipaq Engine stores data as a columner fashion so it’s looks like.   Now we need to fetch data for Customer ‘ABC Company’ and want to know the Total Quntity the specified company purchased. For that we need only columns named Customer and Qty. All others columns are simply eliminated. It actually limit the data by eleminating the columns and called columns elemenation. Segment Elimination This is done by horizontal Partitioning.   For Power Pivot it takes 1 million per partition and for SSAS Tabular it takes 8 million per Partition. Now how it works.
Read more