Experience #
Data Engineer #
SidTips | Fortaleza, CE | 2022
Led the reconstruction of the Historical Database for football matches, enriching and consolidating data on football teams globally since 2015, totaling over 840,000 matches.
- Implemented advanced WebScraping strategies and improved data processing using Spark and Python scripts, reducing the pipeline processing time from 10 days to 3 days.
- Developed and automated the daily ETL for new match collection, result updates, and ML model application. The use of Airflow and Python resulted in monthly savings of over 20 hours in manual activities.
Data Engineer #
Embrapa | Freelance | Fortaleza, CE | 2024
Developed an automated data pipeline to collect, unify, and make available data from the internal system.
- Automated data collection for employee performance evaluation using Python and WebScraping, resulting in the automation of a 2-hour daily routine, totaling 40 hours at the end of the evaluation period. Enabled daily monitoring of results, previously done biweekly.
Web Developer #
SidTips | Freelance | Fortaleza, CE | 2022
Played a key role in building a web platform, involving various responsibilities from planning, development, and implementation of the web app to infrastructure management.
- Created a web app using Vue.js and Quasar framework, efficiently delivering content to customers.
- Developed a robust API using Node.js, enabling efficient communication between different platform components.
- Managed local and AWS cloud infrastructure, ensuring optimal availability and performance, while continuously implementing improvements.
Courses #
- Data Lake – Design, Project, and Integration (Data Science Academy) - 2024
- Design and Implementation of Data Warehouses (Data Science Academy) - 2023
- Data Engineer with Python, Career Track (DataCamp) - 2023
Education #
- MBA in Data Engineering, Specialist - In progress
University of Fortaleza | Fortaleza, Ceará - Bachelor’s Degree in Computer Science
Federal University of Ceará | Fortaleza, Ceará