André Luiz Sevilha
I am a Data Engineer with over eight years of experience with data engineering and have worked since 2006 with databases. I started working with AWS in 2012 and always kept this provider as a focus, but I had also worked with GCP and Azure before. I built data pipelines with several architectures and tools for different purposes and companies' industries.
REVIEWS FROM CLIENTS
Working in factored, I was placed in one of its clients as a DataOps Engineer in a platform team. This client has several data streami...
Working in factored, I was placed in one of its clients as a DataOps Engineer in a platform team. This client has several data streaming services running and several databases. Some pipelines run over 50 million messages per second. In this client, my team and I are responsible for creating the platform for other teams to use.
Main Projects: Swiftline
- Create Python-driven pipelines to bring data from different sources and create analysis on top of ...
Main Projects: Swiftline
- Create Python-driven pipelines to bring data from different sources and create analysis on top of those pipelines.
- At this level of the project, no other tool or cloud was used. Only pure python with pandas and several other libs to create both the pipeline and all the analysis.
BairesDev is an outsourcing company that offers three services: IT Staff augmentation, software outsourcing, and delivery teams.
<...BairesDev is an outsourcing company that offers three services: IT Staff augmentation, software outsourcing, and delivery teams.
Main Projects:
PatientPoint
- Integrate two data environments from two companies that recently merged.
- Using Airflow (on-premise and Astronomer managed instances) to create the pipelines and bring data from several different data sources to be used in Analytical decision-making processes.
Dude Solutions
- Migration of an on-premise system using several clusters with Hadoop, spark, Cassandra, Postgres, and Airflow to a more manageable environment in AWS using mainly DMS, S3, CDK, Glue, and Redshift.
QuantCollective
- Marketing analysis, Growth analysis, and DBT project.