Or listen along with my latest release video:
π¬ youtu.be/7BLoAkrA-h4
Or listen along with my latest release video:
π¬ youtu.be/7BLoAkrA-h4
#ICYMI, #apacheIceberg β’ 1.10 landed yesterday!
Looking to stay up to date on the latest features included as part of the release? I teamed up with Steven Wu to bring you a list of some of the most impactful features in 1.10. Check it out!
π www.snowflake.com/en/engineeri...
There's still time to RSVP for tonight's #apachePolaris (incubating) meetup in the #Seattle / #Bellevue area!
We have an incredible line up of speakers tonightββdon't miss your chance to connect with them, get up to speed on the project, and join in on building out Polaris!
luma.com/s8tik7g0
So good to meet you! Hope to see you again at another conference. π
π Hope to catch you at my #apacheKafka <> #apacheIceberg session!
Listen along and learn a bit more about how they efficiently solve this issue ‡οΈ
I sat down with Roman Kolesnev and learned that Streambased is building out a product that solves this problem exactly! Allowing your #apacheKafka data to be indexed and available immediately (without copying) and queryable through databases, open table formats like #apacheIceberg, or file systems.
But when the time comes to use your infinite data, how do you find the *right* data? #apacheKafka is a log. And even with smart partitioning, you still have to re-stream most of the data in order to find the specific account or key that you're looking for. π
π Back Fill. Use the history of events to rebuild state in other applications/databases.
π° Anxiety? You don't quite know what you'll do with that data now, but you might need it someday!
π Time Travel Analytics. Having the entire history of data means you can easily go back to any time period and analyze those events for fraud, debugging, etc.
π Auditing and Regulatory. Certain industries/companies are required to retain data for a specific length of time
Infinite storage in #apacheKafka is all the rage. But what exactly is your plan when you decide to keep years' worth of data in Kafka topics? π€
From what I've seen, folks opt in for infinite storage for a few reasons:
I also had a chance to work with Yufei Gu, the Polaris 1.0 release manager, to put together a blog that highlights the most important parts of this release. π
www.snowflake.com/en/engineeri...
It's been a great week because the #apachePolaris (incubating) community just announced a milestone release with version 1.0!
Want to know what's included? You're in luck, because there's a release video for that! πΉ
www.youtube.com/watch?v=ST8P...
I'll consult your calendar for the next one! π
Hello, #amsterdam-based #AI enthusiasts! Let's have a meetup!
On July 31, LlamaIndex and Snowflake are coming together to host folks for an evening of discussion around building effective data agents.
Register now to secure your slot! ποΈ
lu.ma/vzwsj72w
It's been a wild ride for #openSource at Snowflake this year!
"What's it like?" you ask? π€
Check out @russellspitzer.bsky.social's Medium blog on his first year at Snowflake. βοΈ
medium.com/snowflake/my...
Interested in speaking? We're still looking for folks to join the agenda. Submit your idea here
π‘ forms.gle/z6Qsj1D53Y1G...
We'll talk all things #apacheIceberg, #dataLakehouse, open table formats, and more. This is a great chance to connect with #openSource community members like @russellspitzer.bsky.social, stay up to data on what's new in the space, and learn more about the open lakehouse movement.
#atlanta #tech community! Come join us for the first official #apacheIceberg meetup in your city on Thursday, July 24!
Don't miss it! RSVP now to secure your space ποΈ
lu.ma/vdbjh2fc
Check out the req for more details π
careers.snowflake.com/us/en/job/SN...
π enjoy creating developer-focused content around #openSource #dataEngineering technologies (think #apacheIceberg, #postgres, #apacheNifi, and more)
π« love building, supporting, and championing the technical community
... then this just might be the role for you!
If you...
ποΈ have experience with #openSource foundations (like the Apache Software Foundation, Linux Foundation, etc.)
βοΈ want the opportunity to work closely with and drive our evolving #OSPO
ποΈ Hot off the press: come join my team! ποΈ
I'm looking for a #developerAdvocate to join my #openSource #developerRelations team at Snowflake.
careers.snowflake.com/us/en/job/SN...
Not convinced? Let's hear from Lester Martin, #starburst, on why else you should care and give #apacheNifi a try π
What about from a #Snowflake perspective?
#apacheNifi is the foundation for Snowflake's data integration service, #openFlow. It's especially useful for multi-modal datasets that you might need for your #AI workflows.
docs.snowflake.com/en/user-guid...
#apacheNifi is an #openSource data workflow tool that's great for #etl, #dataStreaming ingestion, and #dataProcessing pipelines. Its drag-and-drop, no-code interface that makes it easy for developers and #dataEngineering folks to get started.
nifi.apache.org
Have you heard about #apacheNifi? No, well here's your chance to learn a bit about it! π§΅
#snowflakeSummit is over, but all of the keynotes are up on our #Snowflake Youtube channels! For no reason at all, start with the Builders keynote. π
See #agentic workflows in action, an #apacheIceberg #dataMesh, and how the community is coming together on #AI.
www.youtube.com/watch?v=slyY...
Have a use case, integration, or proposed feature you want to share? Submit to speak! We're looking for folks to share a ~20 minute session. The CfP is live and will close on July 7. βοΈ
forms.gle/cABj9Ubcn3qC...
The #apacheIceberg meetup series continues in the #seattle area with a stop at the brand new Snowflake office in Bellevue! βοΈ
Join fellow Iceberg enthusiasts, committers, and users on July 15th for networking, great technical discussions, and more! RSVP to reserve your spot. ποΈ
lu.ma/q9w0j1ky