Marcelo Dias
As a Senior Data Engineer with close to three decades of experience, I possess a diverse background in software engineering, technical leadership, and education, specializing in database and data engineering. I excel in crafting data analytics solutions using a robust skill set encompassing AWS, Python, SQL, NoSQL, Terraformand Machine Learning.
My career journey has revolved around thriving in agile environments, utilizing methodologies like Scrum to design and implement solutions across a spectrum of industries. Notably, I've contributed my expertise to esteemed entities such as Sicredi Bank, IBM, Rio Grande Energia, Procempa, as well as startups including Elofy and Imagen Technologies, spanning financial, technology, utilities, governmental, HR, and healthcare sectors.
My approach is characterized by a proactive, inquisitive nature, coupled with a relentless pursuit of self-improvement and innovation. Bolstering this, I hold a Master's Degree focusing on NLP and Machine Learning, complemented by an AWS Certification.
REVIEWS FROM CLIENTS
- Database programming
- Machine learning
- Database programming
- Machine learning
- Worked on an AWS/DBT data pipeline that ingests data from radiology exams in the Dicom format.
- Developed a lambda functio...
- Worked on an AWS/DBT data pipeline that ingests data from radiology exams in the Dicom format.
- Developed a lambda function to handle this data using Python. When the Dicom files arrive on each partner's s3 bucket, trigger the events to an SQS Queue consumed by the lambda function that saves the transformed data on the output s3 buckets. The AWS components were all deployed using a Terraform project that manages and tracks all the AWS Infrastructure of the company.
- Prepared Redshift Serverless instances to store the pipeline data using Terraform setting up roles and policies to allow Redshift to access data from s3 buckets and creating AWS policies/roles/groups to allow users to access the database with all the permissions tracked through AWS and Terraform Infrastructure project.
- Worked on Python 3.6 to 3.9 company tools upgrade, testing and changing the tools to work in the new version.
- Technologies used: AWS, Python, Terraform, AWS Redshift.
- Working on an HR application with over 100,000 users.
- This solution allows companies, such as Bradesco, Sicredi, and Com...
- Working on an HR application with over 100,000 users.
- This solution allows companies, such as Bradesco, Sicredi, and Companhia Siderurgica Nacional to run staff assessments, surveys, and feedback.
- Utilizing PHP and MySQL with the core business rules developed inside the database via procedures and triggers.
- Maintaining and enhancing the Elofy application with the development of triggers and procedures for the system features.
- Building customized reports to attend clients’ requests.
- Tuning application queries, procedures, and triggers to attend performance requirements and concurrence.
- Providing SQL support to PHP engineers.
- Technologies used: PHP, Amazon RDS, SQL, MySQL.