#058: Data Architecture 101: Lambda Strategy (Stream + Batch)
Jan 03, 2024A huge decision for any data team is how often to refresh data.
While the most common approach is simply batch loading (hourly, daily, etc.).
Sometimes that's just not fast enough.
Sometimes there's data you'd rather get access to in near-real time.
But how can you make that happen?
There are a handful of ways to go about it, but in this video I want to break down one approach known as The Lambda Strategy.
When done right, it can unlock both batch & streaming capabilities for your architecture.
So in this week's video, you'll learn more about this strategy & whether or not it makes sense for your team.
What will you learn?
- The Lambda approach
- Sneaky downsides to consider before implementing
- Example tools to implement this approach
Enjoy!
Looking for more? Here are 2 other ways I can help you:
1. Simple Stack Academy: Join 100+ students in an end-to-end, project-based training. Simple Stack Academy teaches you a 5-Step Framework to design, build & automate reliable end-to-end data architectures using modern tools like dbt & Github. Ideal for both data engineers looking to advance their careers and data team leaders looking for a clear strategy to follow.
2. Consulting Services: Get personalized support to properly implement a well-structured, scalable, and maintainable data architecture at your company. Whether starting from scratch or migrating a legacy design, you'll get custom support each step of the way to make sure it's done right.