#82: The First Step in a Data Architecture (Ingestion)
Mar 05, 2025Everyone wants to do cool things with their data like AI or machine learning.
Or maybe just move to basic reporting instead of Excel sheets.
But none of that is possible unless you first have a way to access your source data in a shared location.
And that is one of the foundational parts of data architecture known as Data Ingestion.
This is something that in the past was extremely custom and complex.
But nowadays is more plug & play and easier to do.
So in this video we're going to talk about what data ingestion is and it's importance at a high level.
We'll discuss some example tools as well as some important things to consider as you decide what route you want to take with your data ingestion.
Enjoy.
Key Topics We'll Cover:
- The importance of Data Ingestion in a pipeline
- Example Tools (Batch & Streaming)
- Considerations & Strategies to review as a team
Looking for more? Here are 2 other ways I can help you:
1. Simple Stack Academy: Join 100+ students in an end-to-end, project-based training. Simple Stack Academy teaches you a 5-Step Framework to design, build & automate reliable end-to-end data architectures using modern tools like dbt & Github. Ideal for both data engineers looking to advance their careers and data team leaders looking for a clear strategy to follow.
2. Consulting Services: Get personalized support to properly implement a well-structured, scalable, and maintainable data architecture at your company. Whether starting from scratch or migrating a legacy design, you'll get custom support each step of the way to make sure it's done right.