Introduction to StreamNative + Snowflake
StreamNative is partnering with Snowflake to provide you with cost-effective, real-time data ingestion to Snowflake. This means providing you with best-in-class data ingestion methods tailored to meet your specific needs. This guide focuses on two data ingestion methods: Streaming Augmented Lakehouse with Snowflake Open Catalog Integration and Kafka and Pulsar Connectors for Snowflake. The following descriptions provide you with an overview of each option. The course content then dives deeper into how to deploy each method.
Streaming Augmented Lakehouse with Snowflake Open Catalog Integration
Cost-effective data streaming directly to Iceberg Tables, with built-in support for Snowflake Open Catalog.
- StreamNative’s Ursa Engine cuts Kafka Costs by 95%. Ursa’a leaderless architecture eliminates most inter-zone traffic and reduces storage costs by writing data directly to object storage.
- Data is automatically compacted into Apache Parquet™ files and committed to Apache Iceberg™ Tables.
- Ursa integrates directly with Snowflake Open Catalog. Your data can be easily accessed in Snowflake enabling cost-effective real-time AI applications.
Explore the following blog posts to learn more or get started now by Creating a Snowflake Streaming Augmented Lakehouse.
- StreamNative Enables Seamless Streaming into Apache Iceberg™ with Snowflake Open Catalog
- You Don’t Need to Shift Everthing Left; Lakehouse-First Thinking is all you need
Kafka and Pulsar Connectors for Snowflake
Snowflake provides two powerful mechanisms for streaming data into its platform: Snowpipe and Snowpipe Streaming APIs. To take advantage of these APIs, pre-built connectors based on Kafka Connect or Pulsar IO can be deployed to move data from StreamNative into Snowflake.
- StreamNative created UniConn to seamlessly support Connectors built for Kafka (Kafka Connect) and Pulsar (Pulsar IO).
- For both Kafka and Pulsar Connectors, StreamNative supports Snowflake Snowpipe and Snowflake Snowpipe Streaming ingestion methods.
- All Snowflake Connectors can be quickly deployed using StreamNative UI.
Explore the following blog post to learn more or get started now by Deploying Kafka and Pulsar Connectors for Snowflake.