In this video we see how to save the Azure Data Factory pipeline logs into a Azure SQL Database. Using stored procedures we store the pipeline output properties into a table where we can analyze them later on. You can find the stored procedures and DDL statements on my GitHub below. We also enable logging in a Data Factory copy activity and move the exported data from the Blob Storage into the Database. This way we store Session Logs too.

Follow me on social media:
LinkedIn: [ Ссылка ]
GitHub: [ Ссылка ]
Facebook: [ Ссылка ]

00:00 - Intro
01:07 - DDL statements & Stored Procedures
15:58 - Saving pipeline logs into Database
17:13 - Pipeline properties for logging
23:07 - Session logging in copy activities
23:32 - Conclusion

свернуть