Attended an event Brewing Data with Snowflake yesterday in Vilnius
Some of they key insights:
- Medallion Architecture (good or bad) is widespread.
- Snowflake and Databricks are clear competitors, targeting similar landscape.
- Open formats are trending: file format, table format, catalog, etc. - the more of them are open source, the better.
- Time travel feature is important, many users already used it for disaster recovery.
- Clear distinction of Storage from Compute (generic cloud approach).
Full text of one of the slides presented:
Strategic Architecture Outlook
- Agility & Future-Proofing - Open, portable data means you can adopt new technologies or switch platforms with minimal friction. No single vendor can hold your data hostage, so you can evolve vour architecture as needed.
- Multi-Cloud and Hybrid - An open data layer can span clouds and on-prem seamlessly. You avoid cloud vendor lock-in and leverage best-of-breed services on different clouds using the same data. This flexibility is key for resilience and optimization.
- Accelerating Innovation - When any team can access data with the tools of their choice, experimentation flourishes. Open data fosters Al/ML and cross-domain analytics since data isn't locked in silos - more innovation and insights from the same data.
- Vendor Leverage - Strategically, using open standards increases your leverage in vendor negotiations. You car opt in or out of services more freely, pushing vendors to provide value (since you're not irreversibly locked to them).