Implementing LIKE Operator in ADF

Introduction

SQL WHERE clause we often use LIKE operator with wild card character (% or _). But in ADF we can’t use it directly. 

We can use heard coded LIKE and wildcard character in Control flow Lookup Activity, but we need to automate the process.

Hope it will be interesting.

 

Case Study

We have a Flat file named DeveloperList.txt and a AZURE SQL Table object named [dbo].[WorkCommesta]

 


 

Now we need to search each [DevName] from DeveloperList.txt to our [dbo].[WorkComments].[comments] table using wild card and LIKE operator.

It just likes SQL command:

 

Select * From Workcommensts WHERE comments LIKE '%Joydeep%'

 

Stored Procedure

 


 

ADF Control Flow

 


 

Outer Lookup Activity

 


 

ForEach Activity

 


 

Inner Lookup Activity (Under ForEach)

 


 

Set Variable Activity (Under ForEach)

 


Stored Procedure Activity (Under ForEach)

 

 

 

 

Output

 

 

Hope you like it.


Comments

Post a Comment

Popular Posts

Working with Python – Module

Image
Introduction In this blog post, we are going to discuss about Python Module. Before that, we have to understand what the module is. Module is a code Library. Remember, when we are at C or C++, we are using #Include statement at beginning of the code to call specific code library. How to Create a Module If we need to create a module, we just save our code with  .py   extension. def  greeting(name):    print ( "Hello, "  + name)   Suppose, we have the above code and we are just saving the code in the name of  mymodule.py Calling Module   import   mymodule mymodule.greeting( "Mayuree" )   Hello, Mayuree   If we are looking at the calling procedure. mymodule . greeting ( "Mayuree" ) mymodule  – Module Name greeting  – Function Name   Can we assign Variable in Module   Module can have function that we already demonstrate. However, it can also have Variables. Example: ...
Read more

Working with Spark – Big Data Hadoop MapReduce

Image
Introduction Before moving to Spark RDD concept, which is the base line of Spark, we need to understand the concept of Hadoop Mapredue. RDD is the improvement of Hadoop Mapreduce to get 100 outputs in memory. In this blog post we are going to discuss about Hadoop Mapredue to understand the concept only. Hope it will be interesting.   What is MapReduce MapReduce is a software framework and programming module to handle huge data. Hadoop is capable to run MapReduce programs which are written in different language like Java, Ruby, Python and C++. How MapReduce Works As the name specified, MapReduce is a combination of Mapping and Reducing.   We can divide the MapReduc into following Sections. ·          Input Splits ·          Mapping ·          Shuffling ·          Reducing   Before exami...
Read more