Senior Data Engineer
MoonPay
2021-12-01-Present
Leading the Data Platform team to secure and strengthen the infrastructure for the company
Deployed a self-hosted non-confluent Kafka...
Leading the Data Platform team to secure and strengthen the infrastructure for the company
Deployed a self-hosted non-confluent Kafka with security, monitoring and alerting to be used outside the data team
Built streaming pipelines to consume transactional and financial data from vendors and partners into BigQuery, BigTable and GCS
Migrating legacy pipelines to more performant systems ensuring backwards compatibility
Guiding and leading mid and junior engineers to writing cleaner, safer and better documented code to think deeper about problems
Finding smarter ways to solve technical and tedious problems with strong automation
Migration of dbt from dbt Cloud to Cloud Build (and later Kubernetes) to reduce costs, increase performance and increase frequency
Build on top of existing open source tools to enrich features, mostly with dbt and Airflow to get better alerting and pipelines
Python
Java
Flask
GitHub
Composer
Google BigQuery
Docker
Apache Kafka
Kubernetes
Apache Airflow
View more