Job Description

• Continuously monitor the health and performance of data pipelines (Striim), databases, and Linux servers.
• Utilize monitoring tools and dashboards to track data flow, system resources, and data quality.
• Respond promptly to alerts and anomalies to ensure data availability and reliability.

• Investigate and troubleshoot issues and anomalies detected during monitoring.
• Identify the root causes of problems related to data pipelines, Striim, ETL processes, SQL Server, Oracle, or Linux systems.
• Develop and implement solutions to resolve data-related issues promptly.

• Collaborate with development teams to deploy new data pipelines, updates, and changes.
• Ensure proper testing and validation of ETL processes and data pipelines before deployment.
• Monitor the deployment process to identify and address any issues in real-time.

• Regularly check and maintain data quality by validating data against predefined standards and data governance policies.
• Fix data quality issues and errors in data pipelines to maintain accurate data.

• Implement automation for deploying data pipelines and updates to improve efficiency and reduce deployment errors.
• Use tools like Ansible or Docker for containerization and orchestration.

• Collaborate with cross-functional teams, including data scientists, analysts, and software developers, to understand their data needs and provide.
• Engage in regular communication to ensure alignment on data-related activities and issue resolution. "

Job Tags

Similar Jobs