Senior Data Engineer
Accenture
2024-10-01-Present
Senior Data Engineer at a Fortune 500 client -> JTI
- Design, development, deployment of data driven solu...
Senior Data Engineer at a Fortune 500 client -> JTI
- Design, development, deployment of data driven solutions.
- Building end-to-end automation systems and data pipelines with ADF, Databricks, Synapse, PowerBI.
- Integrating data from sources such as : Teleperformance, AmazonConnect, ServiceNow, Trustpilot, etc.
- Audio/video file processing, translation, PII anonymization, handling JSON data, etc.
- Working with SCRUM, Git, Azure DevOps, etc.
Tech Stack : Azure DevOps, Git, Python, SQL, Databricks, ADF, Synapse, ADLS, LogicApps, AZF, etc
Python
SQL
Oracle
Azure
Salesforce
Apache Spark
HubSpot
Databricks
View more
Data and Software Engineer Consultant
-[Part-time] Azure Solutions Architect Expert at Analytikus.
-Cutting the gap between billing and costs across customer accounts
-Setting...
-[Part-time] Azure Solutions Architect Expert at Analytikus.
-Cutting the gap between billing and costs across customer accounts
-Setting up alerting/monitoring across resources
-Optimizing Synapse Analytics instances.
-Optimizing SQL Databases.
-[Part-time] Integration of data and systems in the gas industry at FRDMConsulting
-Creation of optimized schemas for GIS solutions
-Remodelling python modelling systems.
-Creation of change data capture systems against source systems.
-[Completed] Optimization of Databricks ML/Analytics pipelines at Frontline
-Optimization ML pipelines for the automation of training of a large language model.
Tech : Azure, Python, SQL, Databricks, Pyspark, Pandas, GeoPandas, Microsoft Access, Geodatabases, Azure DevOps,ARM, PowerShell.
Python
PowerShell
Azure
View more
Python
PowerShell
Azure
ARM
GIS
Apache Spark
Databricks
View more
Data Engineer
Languagewire Translation Services
2023-04-01-2023-12-01
– Responsible for managing data pipeline infrastructure for ETL in Azure, utilizing a wide range of data sources (both relational and non...
– Responsible for managing data pipeline infrastructure for ETL in Azure, utilizing a wide range of data sources (both relational and non-relational).
– Implemented CI/CD pipelines and productionized solutions with Azure DevOps.
– Performed tasks such as:
Integrating new data sources (via APIs, data transfers, etc.).
Data cleaning and aggregation.
Reverse ETL (data delivery to external systems).
Building new and maintaining existing tabular cubes.
– Assembled large and complex data sets to meet both functional and non-functional business requirements.
– Identified and automated process improvements, optimizing data loads, etc.
– Ensured operational stability, regularly performed tests and evaluations to guarantee data integrity.
Technologies:
Azure, Azure DevOps, Databricks, REST API, ADF, SSAS, Python, SQL, C#/.Net, Elasticsearch, Git, Logic Apps, Azure Functions, Azure SQL Server, IAC, ARM, PowerShell.
Python
C#
SQL
PowerShell
Azure
Elasticsearch
SQL Server 2012
ARM
Apache Spark
ADF
Analysis Services
.NET Core
Azure Functions
RESTful API
Databricks
Azure logic apps
View more