José David Arévalo – Medium

José David Arévalo

José David Arévalo
in
AWS in Plain English

From Redshift to Athena: A Data Engineering Team’s Journey to 90% Cost Reduction and Performance…

As a data engineer, I’ve worked on numerous projects where balancing performance with cost has been a critical challenge. Today, I’m…

Sep 24

From Redshift to Athena: A Data Engineering Team’s Journey to 90% Cost Reduction and Performance…

Sep 24

José David Arévalo
in
AWS in Plain English

When AWS Athena costs skyrocket: Key lessons and how to avoid them

In the realm of data engineering, choosing the right tools and technologies is critical for efficiently managing and analyzing data. AWS…

Jul 3

When AWS Athena costs skyrocket: Key lessons and how to avoid them

Jul 3

José David Arévalo
in
Python in Plain English

Introducing AtomicExecutionControl: Streamline Your Data Engineering Workflows

In the rapidly evolving data engineering landscape, the introduction of serverless architectures like AWS Lambda and Fargate has unlocked…

Mar 20

logs when trigger the lambda two times, and check only one lambda runs, while the other wait until the first finish

Mar 20

José David Arévalo
in
AWS in Plain English

A Serverless, User-Centric Framework: Automating Athena Query Execution

In today’s dynamic big data environment, speed and efficiency in query execution are paramount. AWS Athena serves as a potent tool for…

Dec 28, 2023

A Serverless, User-Centric Framework: Automating Athena Query Execution

Dec 28, 2023

José David Arévalo

From grieving to opportunity: The journey of the survivors of layoffs

In a scenario where companies of all sizes, from Google or Amazon to startups, announce layoffs, those of us who remain in our positions…

Sep 22, 2023

From grieving to opportunity: The journey of the survivors of layoffs

Sep 22, 2023

José David Arévalo

Del duelo a la oportunidad: La travesía de los sobrevivientes a despidos masivos

En un escenario donde empresas de todos tamaños, desde Google o Amazon hasta startups, anuncian despidos masivos, quienes permanecemos en…

Sep 22, 2023

Del duelo a la oportunidad: La travesía de los sobrevivientes a despidos masivos

Sep 22, 2023

José David Arévalo
in
AWS in Plain English

Serving Data Safely: Managing Versions and Environments with API Gateway and Lambda

As a data engineer, you might not first think of creating and maintaining APIs; instead, you’re likely more involved in data pipelines, ETL…

Sep 1, 2023

Serving Data Safely: Managing Versions and Environments with API Gateway and Lambda

Sep 1, 2023

José David Arévalo
in
AWS in Plain English

Scalable Data Processing with AWS Serverless Scatter-Gather Pattern Implementation

Data engineering plays a critical role in managing, processing, and extracting value from substantial volumes of data. The Scatter-Gather…

Apr 21, 2023

Serverless Scatter Gather architecture

Apr 21, 2023

José David Arévalo
in
AWS in Plain English

Slash Command in Slack to trigger Athena queries and receive reports

In our daily work as data engineers, we need to design and implement pipelines to be the data accessible to the users, no matter if the…

Aug 26, 2022

Slash Command in Slack to trigger Athena queries and receive reports

Aug 26, 2022

José David Arévalo
in
Level Up Coding

Creating and filling a Postgres DB with Docker compose

Many times we need to be able to fill and eventually share a database with dummy data, either to test our pipelines, test queries, make a…

Jan 30, 2021

Creating and filling a Postgres DB with Docker compose

Jan 30, 2021

José David Arévalo

José David Arévalo

Data Engineer, my passion is data, my hobby is work with data. I love to learn, I enjoy teaching, and I'm excited about data related challenges bit.ly/in_jdaa

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams