José David Arévalo – Medium

José David Arévalo

José David Arévalo
in
Python in Plain English

Introducing AtomicExecutionControl: Streamline Your Data Engineering Workflows

In the rapidly evolving data engineering landscape, the introduction of serverless architectures like AWS Lambda and Fargate has unlocked…

4 min readMar 20, 2024

--

logs when trigger the lambda two times, and check only one lambda runs, while the other wait until the first finish

--

José David Arévalo
in
AWS in Plain English

A Serverless, User-Centric Framework: Automating Athena Query Execution

In today’s dynamic big data environment, speed and efficiency in query execution are paramount. AWS Athena serves as a potent tool for…

4 min readDec 28, 2023

--

A Serverless, User-Centric Framework: Automating Athena Query Execution

--

José David Arévalo

From grieving to opportunity: The journey of the survivors of layoffs

In a scenario where companies of all sizes, from Google or Amazon to startups, announce layoffs, those of us who remain in our positions…

4 min readSep 22, 2023

--

1

From grieving to opportunity: The journey of the survivors of layoffs

--

1

José David Arévalo

Del duelo a la oportunidad: La travesía de los sobrevivientes a despidos masivos

En un escenario donde empresas de todos tamaños, desde Google o Amazon hasta startups, anuncian despidos masivos, quienes permanecemos en…

4 min readSep 22, 2023

--

Del duelo a la oportunidad: La travesía de los sobrevivientes a despidos masivos

--

José David Arévalo
in
AWS in Plain English

Serving Data Safely: Managing Versions and Environments with API Gateway and Lambda

As a data engineer, you might not first think of creating and maintaining APIs; instead, you’re likely more involved in data pipelines, ETL…

5 min readSep 1, 2023

--

Serving Data Safely: Managing Versions and Environments with API Gateway and Lambda

--

José David Arévalo
in
AWS in Plain English

Scalable Data Processing with AWS Serverless Scatter-Gather Pattern Implementation

Data engineering plays a critical role in managing, processing, and extracting value from substantial volumes of data. The Scatter-Gather…

10 min readApr 21, 2023

--

Serverless Scatter Gather architecture

--

José David Arévalo
in
AWS in Plain English

Slash Command in Slack to trigger Athena queries and receive reports

In our daily work as data engineers, we need to design and implement pipelines to be the data accessible to the users, no matter if the…

12 min readAug 26, 2022

--

Slash Command in Slack to trigger Athena queries and receive reports

--

José David Arévalo
in
Level Up Coding

Creating and filling a Postgres DB with Docker compose

Many times we need to be able to fill and eventually share a database with dummy data, either to test our pipelines, test queries, make a…

4 min readJan 30, 2021

--

6

Creating and filling a Postgres DB with Docker compose

--

6

José David Arévalo

José David Arévalo

Data Engineer, my passion is data, my hobby is work with data. I love to learn, I enjoy teaching, and I'm excited about data related challenges bit.ly/in_jdaa

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams