Juan Pablo Navarro Rueda

Data engineer

About Me

I am a data engineer with years of experience. I have worked in different industries including health/research, infrastructure (IoT), software and supply process in an oil and gas Company

Experience

Data integration specialist

Datadivers.io - Woodside | Dec 2023 -

  • Ingest data from snowflake into S3 to be later consumed by other AWS services.
  • Build DBT models for snowflake platform.
  • Manage a partnership in the technical aspect of it.

Data engineer

Datadivers.io - INX | Sept 2023 - Nov 2023

  • Build event triggered ETLs using AWS MWAA (Airflow).
  • Deploy infrastructure using octopus.
  • Alert status of the ETLs using Airflow connectors such as slack-connector.

Data engineer

Datadivers.io - TKI | May 2023 - Aug 2023

  • Build serverless solution to read data from an AWS RDS instance.
  • Developed and managed AWS Cognito user pool for mobile app users.
  • Maintain infrastructure as code using CDK.

Data engineer

Datadivers.io - Arc | May 2022 - Feb 2023

  • Retrieve data from loggers.
  • Managed and deploy infrastructure in on premise servers.
  • Monitor infrastructure as well as data pipelines using tools to automate the process.

Education

Degree

Western Sydney University | Feb 2022

Masters of Data Science.
Specialisation in Artificial Intelligence

Degree

Universidad Industrial de Santander (UIS) | Dec 2018

Bachelors of Electronic engineering.

Certifications