Error Notifications for Snowflake Tasks using SNS скачать в хорошем качестве

Error Notifications for Snowflake Tasks using SNS

In Today’s video , let’s have a look how you can create an error notification for tasks in Snowflake using AWS SNS. Then anytime if anyone from monitored tasks fail, email will be send to subscribed email addresses so the operations team is immediately informed about the failure and can react accordingly. Documentation : https://docs.snowflake.com/en/user-gu... Prerequisite: ----------------------- Snowflake Snowpipe - Email Alert Mechanism    • Snowflake Snowpipe - Email Alert Mechanism   Architecture : --------------------------- https://github.com/SatadruMukherjee/D... SNS Policy used in this video: ---------------------------------------------------- { "Version": "2012-10-17", "Statement": [ { "Effect": "Allow", "Action": [ "sns:Publish" ], "Resource": "{}" } ] } SQL Query: ----------------------- --drop database if required drop database if exists ramu; --Create Database create database if not exists ramu; --use the database use ramu; // Prepare table CREATE OR REPLACE TABLE video_demo ( ID INT AUTOINCREMENT START = 1 INCREMENT =1, NAME VARCHAR(40) DEFAULT 'DemoYoutube' , CREATE_DATE timestamp); CREATE NOTIFICATION INTEGRATION notifyme123 ENABLED = true TYPE = QUEUE NOTIFICATION_PROVIDER = AWS_SNS DIRECTION = OUTBOUND AWS_SNS_TOPIC_ARN = '{}' AWS_SNS_ROLE_ARN = '{}'; DESC NOTIFICATION INTEGRATION notifyme123; // Create task CREATE OR REPLACE TASK INSERT_DATA_NOTIFICATION123 WAREHOUSE = COMPUTE_WH SCHEDULE = '1 MINUTE' error_integration = notifyme123 AS INSERT INTO video_demo(CREATE_DATE) VALUES(CURRENT_TIMESTAMP); SHOW TASKS; // Task starting and suspending ALTER TASK INSERT_DATA_NOTIFICATION123 RESUME; SELECT * FROM TABLE(INFORMATION_SCHEMA.TASK_HISTORY()) WHERE SCHEMA_NAME = 'PUBLIC' AND NAME = 'INSERT_DATA_NOTIFICATION123' ; SELECT * FROM video_demo; DROP TABLE video_demo; ALTER TASK INSERT_DATA_NOTIFICATION123 SUSPEND; drop task INSERT_DATA_NOTIFICATION123; Check this playlist for more Data Engineering related videos:    • Demystifying Data Engineering with Cloud C...   Snowflake Complete Course from scratch with End-to-End Project with in-depth explanation-- https://doc.clickup.com/37466271/d/h/... 🙏🙏🙏🙏🙏🙏🙏🙏 YOU JUST NEED TO DO 3 THINGS to support my channel LIKE SHARE & SUBSCRIBE TO MY YOUTUBE CHANNEL