Data Engineer by trade with previous experience as Back-End Software Engineer and Data Scientist.
I consider myself as a fast learn, research-minded, analytical thinker who likes to tinker with new things.
Francisco's profile has been carefully vetted and approved as a Codementor. Connect with Francisco now, and leave a review for them once you're done!
SOCIAL PRESENCE
GitHub
ComputerVision
This repo contains sample files of various Computer Vision tasks I carried out as researcher and developer in the field early in my career
C++
0
0
dockerized-react-app
This is a dockerized react app that I developed while learning docker.
0
0
EMPLOYMENTS
Data and Software Engineer Consultant
Upwork
2024-01-01-Present
-[Part-time] Azure Solutions Architect Expert at Analytikus.
-Cutting the gap between billing and costs across customer accounts
-Setting...
-[Part-time] Azure Solutions Architect Expert at Analytikus.
-Cutting the gap between billing and costs across customer accounts
-Setting up alerting/monitoring across resources
-Optimizing Synapse Analytics instances.
-Optimizing SQL Databases.
-[Part-time] Integration of data and systems in the gas industry at FRDMConsulting
-Creation of optimized schemas for GIS solutions
-Remodelling python modelling systems.
-Creation of change data capture systems against source systems.
-[Completed] Optimization of Databricks ML/Analytics pipelines at Frontline
-Optimization ML pipelines for the automation of training of a large language model.
Tech : Azure, Python, SQL, Databricks, Pyspark, Pandas, GeoPandas, Microsoft Access, Geodatabases, Azure DevOps,ARM, PowerShell.
Python
PowerShell
Azure
View more
Python
PowerShell
Azure
ARM
GIS
Apache Spark
Databricks
View more
Data Engineer
Languagewire Translation Services
2023-04-01-2023-12-01
– Responsible for managing data pipeline infrastructure for ETL in Azure, utilizing a wide range of data sources (both relational and non...
– Responsible for managing data pipeline infrastructure for ETL in Azure, utilizing a wide range of data sources (both relational and non-relational).
– Implemented CI/CD pipelines and productionized solutions with Azure DevOps.
– Performed tasks such as:
Integrating new data sources (via APIs, data transfers, etc.).
Data cleaning and aggregation.
Reverse ETL (data delivery to external systems).
Building new and maintaining existing tabular cubes.
– Assembled large and complex data sets to meet both functional and non-functional business requirements.
– Identified and automated process improvements, optimizing data loads, etc.
– Ensured operational stability, regularly performed tests and evaluations to guarantee data integrity.
Technologies:
Azure, Azure DevOps, Databricks, REST API, ADF, SSAS, Python, SQL, C#/.Net, Elasticsearch, Git, Logic Apps, Azure Functions, Azure SQL Server, IAC, ARM, PowerShell.
Python
C#
SQL
View more
Python
C#
SQL
PowerShell
Azure
Elasticsearch
SQL Server 2012
ARM
Apache Spark
ADF
Analysis Services
.NET Core
Azure Functions
RESTful API
Databricks
Azure logic apps
View more
Data Engineer
Machtfit Gmbh
2020-11-01-2022-01-01
– Implemented a data mart for the world maritime trade sector (Kapital).
– Ingested, transformed, processed, and loaded high-volume (tera...
– Implemented a data mart for the world maritime trade sector (Kapital).
– Ingested, transformed, processed, and loaded high-volume (terabyte-scale) structured and unstructured data sets.
– Developed ETL/ELT solutions that combine, merge, and integrate multiple data sources.
– Performed quality and integrity assessments for newly available data.
Technologies:
Azure, Azure DevOps, Python, SQL, Databricks, ADF, SSIS, C#/.Net, Git, pandas, Logic Apps, SQL Server, ARM, PowerShell.
