Deploy Snowflake Sink Connector (Pulsar IO)
This guide assumes you have already deployed a StreamNative Cluster using the Classic Engine (available with Serverless, Dedicated, or BYOC deployment options). To get started quickly using a $200 Free Credit, follow Cluster Setup for Getting Started with Pulsar on StreamNative to deploy a Serverless Cluster using the Classic Engine.
In this example we:
- Deploy a Snowflake Streaming Sink Connector (Pulsar IO)
- Produce Pulsar Messages with AVRO schema using a Java Client
- Query results in Snowflake
The following fields are configured using StreamNative UI:
- Sink Name
- Subscription
- Service Account (provided consume and sinks permissions, and Service Account Binding)
- Input topic: Tenant, Namespace, and Topic
- User
- Authentication Secrets
- Host
- Database
- Schema
For this test, Pulsar messages are published to topic snowpipe with AVRO Schema with fields sensor_name, timestamp, and value. The resulting table will have two columns of RECORD_METADATA and RECORD_CONTENT.
Documentation for Snowflake Sink Connector (Pulsar IO)