2

I am trying to use Event Grid to kick off an Azure Data Factory pipeline when a new record is inserted into an Azure SQL database table. But, I'm lost at the start of things.

When creating the new subscription, I think I would choose Custom Input Schema but I'm not sure where to even start with where to get the "Event Type" from. Is there a list of types somewhere? Is this in the documentation of Azure SQL or Event Grid?

What is the right event type? Any help would be appreciated.

Reference: https://learn.microsoft.com/en-us/azure/event-grid/event-sources

NOTE: I cannot use Logic Apps for this as that has not been approved by our Azure architecture team. I say this because Logic Apps SQL connector now allows for a trigger based on SQL table insert -- no matter though, because I cannot use Logic Apps :(

Improve this question

2 Answers 2

Reset to default
5

At this moment, SQL Database doesn't publish events to Event Grid, so you can't use this approach.

You can change your code and right after insert on SQL, publish a custom event to Event Grid, or switch to CosmosDB which offers the Change Feed (which you can subscribe and react to events)

Improve this answer
Sign up to request clarification or add additional context in comments.

4 Comments

After scouring the azure portal for an hour, I believe your answer to be true. This contradicts the "What is Azure Event Grid?" page that specifically says "... use Event Grid to notify Azure Automation when a virtual machine or database in Azure SQL is created". source
I will follow this internally with MSFT engineers.
@ThiagoCustodio The documentation is still refers to use Event Grid to notify Azure Automation when a virtual machine or database in Azure SQL is created, did you get any clarity from MSFT engineers on this, now possible maybe?
Unfortunately, no news =/
1

Yes, at the moment there is no event sync integration to the Azure Event grid, however, for purpose of exploring other venues, you might find Debezium a place for syncing most of the data sources into a Kafka or other streams with little custom code.

Reference SQL Server Debezium Connector

Note: the few of the connectors are in testing phase, and it is a little time taking task to write or customize the connector, but can be done.

I felt this technology mostly usefull for integrating or migrating complex distributed systems with legacy components working together.

Improve this answer

Comments

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.