View All Jobs
System Engineer / Senior System Engineer
Chennai
Job Description
We are hiring a Senior System Engineer with 3+ years of experience, including 2+ years in Data Engineering Support. The role involves Data Engineering, monitoring, and optimization with strong skills in Python, SQL, and cloud (AWS/Azure/GCP)
- Provide L2/L3 production support for data engineering platforms and pipelines.
- Monitor, troubleshoot, and resolve issues in Azure Data Factory (ADF), Databricks, and SQL-based workflows.
- Manage data migration, ingestion, and transformation processes across multiple environments.
- Collaborate with data engineers, analysts, and business stakeholders to ensure smooth delivery of data solutions.
- Implement incident management, root cause analysis, and preventive measures to minimize downtime.
- Optimize performance of ETL/ELT pipelines and ensure adherence to SLAs.
- Automate monitoring and alerting processes using scripting (Python/PowerShell).
- Maintain documentation for production support processes, runbooks, and knowledge base.
- Participate in on-call rotations and provide timely support for critical issues.
- Ensure compliance with data governance, security, and quality standards.
Job Requirement
- Bachelor’s degree in computer science, Information Technology, Data Engineering, or a related field.
- Good Hands-on experience of Azure Data Factory / Databricks/ ADB Notebook*
- Secondary knowledge of ETL Tools (Ex DataStage, Informatica, Oracle Data integrator or SSIS ) SQL, PL SQL, Unix/Linux commands, monitoring of batch processes, and troubleshooting required.
- Working knowledge of ITSM tools and schedulers.
- Understanding of any one of the scripting tools Perl/Python/UNIX Shell.
- Awareness of Support Process and best practices.
- Inform stakeholders in case of any failure or SLA miss. Involve the appropriate team to debug & fix the issue.
- Should have good written and verbal communication skills.
- Ability to work independently and work in a team in a collaborative fashion.