Scheduled Tasks Monitoring in DevOps

In this ETL pipeline, a Python script reads Windows Task Scheduler jobs along with detailed information about them, such as their schedule, folder paths, triggers, last run results etc. and transforms this information into JSON format. After that, JSON output is uploaded to a specific folder in Sharepoint.

flow-02

A flow is created in Power Automate that gets triggered by a change in that Sharepoint folder, parses the information in the JSON file, and updates Azure observers given below.

observer

Finally, a query in Azure DevOps lists all observers in Project Portfolio page. This way, automated jobs in different remote servers can be monitored in one place and the jobs with issues can be easily located for further action. dashboard

Committed, self-motivated, and proactive Data Engineer with more than 6 years of experience in software development and 4+ years of experience working with data, including but not limited to data analytics & visualization, ETL, data migration, and integrating third-party systems.

Related