Senior Data Engineer
Technology, Data & Digital · Data, AI & Analytics · Data Engineering
In short
Sandvik Mining & Rock Technology seeks a Senior Data Engineer in Bangalore to lead the design and implementation of enterprise-scale data infrastructure and processing pipelines using Azure. This role involves developing ETL/ELT solutions, managing data workflows, and optimizing data performance.
Responsibilities
- Design, develop, and maintain ETL/ELT data pipelines using Azure Data Services.
- Build and manage data workflows using Azure Data Factory / Synapse Pipelines.
- Ingest data from multiple sources (databases, APIs, flat files, cloud storage).
- Perform data transformation, cleansing, and enrichment to support analytics use cases.
- Optimize data pipelines, storage, and compute resources for performance and cost efficiency.
- Monitor, troubleshoot, and resolve pipeline failures and data quality issues.
- Collaborate with data analysts, data scientists, and application teams to understand data requirements.
- Implement best practices for data security, reliability, and scalability.
- Participate in Agile ceremonies and contribute to continuous improvement initiatives.
Requirements
- Bachelor’s degree in Computer Science, IT, Engineering, or a related discipline.
- 8–12 years of experience in data engineering or data platform development roles.
- Hands-on experience working with Azure Data Services in production environments.
- Experience delivering data solutions for analytics, reporting, or business intelligence.
- Strong hands-on experience with Azure Data Factory, Azure Databricks and Azure Synapse Analytics.
- Experience with ETL/ELT pipelines, data integration, and orchestration frameworks.
- Proficiency in SQL and strong understanding of relational and analytical data models.
- Experience with Azure Data Lake Storage (ADLS) and data storage optimization techniques.
- Knowledge of resource optimization, cost management, and performance tuning in Azure.
- Familiarity with CI/CD for data pipelines.
- Understanding of data security, access control, and governance in Azure environments.
- Strong analytical and problem-solving abilities to troubleshoot complex data pipelines and distributed data systems.
- Ability to perform data-driven analysis and quantitative reasoning.
- Strong written and verbal communication skills.
Desired Qualifications
- Experience with PySpark / Python for data processing.
- Exposure to Power BI or other BI/reporting tools.
- Knowledge of Azure Monitor, Log Analytics, or pipeline monitoring tools.
- Experience with streaming data (Event Hubs, Azure Stream Analytics).
- Azure certifications such as DP-203 (Azure Data Engineer Associate).
- Experience working in large-scale enterprise data platforms.
- Ability to drive alignment across global, cross-functional teams by leading technical discussions, negotiating priorities, and influencing decisions to deliver high-impact outcomes on time.
- Proactive in driving alignment via updates, documentation, and follow-ups across cross-functional teams.
#data engineering#azure#etl#elt#data pipelines#data lakehouse#analytics#business intelligence