Data Engineer by trade with previous experience as Back-End Software Engineer and Data Scientist.
I consider myself as a fast learn, research-minded, analytical thinker who likes to tinker with new things.
Francisco's profile has been carefully vetted and approved as a Codementor. Connect with Francisco now, and leave a review for them once you're done!
SOCIAL PRESENCE
GitHub
ComputerVision
This repo contains sample files of various Computer Vision tasks I carried out as researcher and developer in the field early in my career
C++
0
0
dockerized-react-app
This is a dockerized react app that I developed while learning docker.
0
0
EMPLOYMENTS
Data and Software Engineer Consultant
Upwork
2024-01-01-Present
-[Part-time] Azure Solutions Architect Expert at Analytikus.
-Cutting the gap between billing and costs across customer accounts
-Setting...
-[Part-time] Azure Solutions Architect Expert at Analytikus.
-Cutting the gap between billing and costs across customer accounts
-Setting up alerting/monitoring across resources
-Optimizing Synapse Analytics instances.
-Optimizing SQL Databases.
-[Part-time] Integration of data and systems in the gas industry at FRDMConsulting
-Creation of optimized schemas for GIS solutions
-Remodelling python modelling systems.
-Creation of change data capture systems against source systems.
-[Completed] Optimization of Databricks ML/Analytics pipelines at Frontline
-Optimization ML pipelines for the automation of training of a large language model.
Tech : Azure, Python, SQL, Databricks, Pyspark, Pandas, GeoPandas, Microsoft Access, Geodatabases, Azure DevOps,ARM, PowerShell.
Python
PowerShell
Azure
View more
Python
PowerShell
Azure
ARM
GIS
Apache Spark
Databricks
Azure DevOps Server
View more
Data Engineer
Languagewire Translation Services
2023-04-01-2023-12-01
– Responsible for managing data pipeline infrastructure for ETL in Azure, utilizing a wide range of data sources (both relational and non...
– Responsible for managing data pipeline infrastructure for ETL in Azure, utilizing a wide range of data sources (both relational and non-relational).
– Implemented CI/CD pipelines and productionized solutions with Azure DevOps.
– Performed tasks such as:
Integrating new data sources (via APIs, data transfers, etc.).
Data cleaning and aggregation.
Reverse ETL (data delivery to external systems).
Building new and maintaining existing tabular cubes.
– Assembled large and complex data sets to meet both functional and non-functional business requirements.
– Identified and automated process improvements, optimizing data loads, etc.
– Ensured operational stability, regularly performed tests and evaluations to guarantee data integrity.
Technologies:
Azure, Azure DevOps, Databricks, REST API, ADF, SSAS, Python, SQL, C#/.Net, Elasticsearch, Git, Logic Apps, Azure Functions, Azure SQL Server, IAC, ARM, PowerShell.
Python
C#
PowerShell
View more
Python
C#
PowerShell
Azure
Elasticsearch
SQL Server 2012
ARM
Apache Spark
ADF
Analysis Services
SQL Programming
.NET Core
Azure Functions
RESTful API
Databricks
Azure logic apps
Azure DevOps Server
View more
Data Engineer
Machtfit Gmbh
2020-11-01-2022-01-01
– Implemented a data mart for the world maritime trade sector (Kapital).
– Ingested, transformed, processed, and loaded high-volume (tera...
– Implemented a data mart for the world maritime trade sector (Kapital).
– Ingested, transformed, processed, and loaded high-volume (terabyte-scale) structured and unstructured data sets.
– Developed ETL/ELT solutions that combine, merge, and integrate multiple data sources.
– Performed quality and integrity assessments for newly available data.
Technologies:
Azure, Azure DevOps, Python, SQL, Databricks, ADF, SSIS, C#/.Net, Git, pandas, Logic Apps, SQL Server, ARM, PowerShell.
