Data Platform Monitoring Specialist

Technologies we use

About the project

Your responsibilities

• Monitoring the health of data platform components (Azure, Databricks, Data Factory)
• Overseeing execution of data pipelines (ETL/ELT)
• Analyzing alerts and identifying anomalies in system behavior
• Verifying correctness of data processing
• Identifying, analyzing, and classifying incident
• Communicating incidents and statuses (impact, ETA, progress)
• Coordinating the incident resolution process
• Escalating issues to appropriate teams (Data Engineering, DevOps, Backend)
• Analyzing logs, metrics, and system dependencies
• Identifying root causes (data / pipeline / infrastructure / application)
• Attempting to resolve issues not caused by application defects (e.g., pipeline reruns, job restarts)
• Creating and maintaining documentation (runbooks, procedures)
• Participating in post-mortem analysis of incidents
• Proposing improvements in monitoring and operational processes

Our requirements

• Knowledge of the Microsoft Azure environment
• Proficiency in SQL (queries, data validation)
• Basic knowledge of Python (analysis / logic / debugging)
• Experience working with logs and monitoring systems
• Understanding of data pipelines (ETL/ELT)
• Familiarity with tools such as Azure DevOps and Jira

Optional

• Experience with monitoring tools (e.g., Azure Monitor, Log Analytics)
• Experience with Azure Data Factory and Databricks
• Understanding of distributed systems and microservices
• Experience working in production environments (support / operations / NOC / SRE)

This is how we work on a project

Benefits