How and why I built Extract data of more than 100 tables to text files.
About me
SSIS and Data warehouse Developer.
The problem I wanted to solve
Developing ETL for tables to extract data into text files but dynamically means that by writing BIML Script.
What is Extract data of more than 100 tables to text files.?
BIML is Business Intelligence Markup Language to build SSIS ETL dynamically.
Tech stack
I used SSIS, SQL Server and BIML.
The process of building Extract data of more than 100 tables to text files.
First I create a meta data base in which the name of the tables , its column are stored for which I need to extract data. Then I write a stored procedure that give me the select statement against all the tables for data selection. Then I build SSIS ETL dynamically using BIML.
Challenges I faced
Need to understand BIML.
Key learnings
Building SSIS ETL Dynamically with less effort and saves time.
