I been working in relation of Data treatment since 5 years now and was part of different clients that tought me about multiple disciplines and subjects, which gave me experience not only in modern technologies but as well as domain knowledge and client counseling.
ETL processes and data pipelines creation, data architecture design, counseling and execution of best practices regarding data treatme...
ETL processes and data pipelines creation, data architecture design, counseling and execution of best practices regarding data treatment.
Real-Time application development for the most important Bank Holding Group in Colombia.
AWS Cloud Architecture design and prog...
Real-Time application development for the most important Bank Holding Group in Colombia.
AWS Cloud Architecture design and programming using the following technologies: - AWS: S3, Redshift, Kinesis – Databricks – Java, Python – Apache Spark.
For another project i've been asign to, i'm in charge of designing Microsoft Azure Cloud architecture, building & designing the ETL and data flow lifecycle (Oil Company).
Using: - Azure Data Factory - Azure Data Lake Storage - Azure Databricks - Python In constant contact with client for gathering requirements.
As a Data Engineer i am in charge of building the Core Application for processing and transforming data, designing the Data Pipeline f...
As a Data Engineer i am in charge of building the Core Application for processing and transforming data, designing the Data Pipeline from the source to the curated area.
Technologies used: - Spark - Scala - HDFS - Parquet - Hive - Impala - Sqoop I also built an application to extract metadata from hive so to keep table's versions up to date.
Technologies used: - Python - Hive - Elasticsearch - Json Other tasks i've been assigned to were gathering the As Is technologies with the client of pharmaceutical industry, so that the To Be solution was the one that perfect fit. And helping with the Data Warehousing design.