Senior Technical Lead

Technology, Data & Digital · Data, AI & Analytics · Data Engineering

In short

Data Engineer (Talend/Databricks) role in Pune, India, focusing on designing and maintaining scalable data pipelines and ETL processes. The position requires a minimum of 5 years of experience, strong SQL and Python skills, and familiarity with cloud platforms like Microsoft Azure.

Responsibilities

Design, develop, and maintain scalable data pipelines and ETL processes.
Implement ETL processes to ingest, transform, and load data from various sources.
Ensure data quality, security, and compliance.
Optimize and fine-tune data systems for performance and scalability.
Develop and document data architecture and processes.
Collaborate with data scientists and analysts to understand data requirements.
Work closely with cross-functional teams to support data-driven decision-making.
Monitor and troubleshoot data pipeline issues.
Troubleshoot and resolve data-related issues and support users.
Monitor ETL processes, proactively identifying and resolving issues or performance bottlenecks to maintain high system reliability.
Review data transformation and ingestion patterns, including CDC, schema evolution, and error handling for robust data operations.
Document ETL workflows, data mappings, and process changes to ensure transparency and clear communication across technical and non-technical teams.
Stay updated with the latest features and best practices.

Requirements

Degree in Computer Science, Data Engineering, Information Technology or a related field.
A minimum of 5 years of professional experience in data engineering or a related role.
Proven experience as a Data Engineer with a focus on Databricks / Talend.
Strong programming skills in SQL and Python.
Experience with cloud computing platforms (preferably Microsoft Azure).
Proficiency in CDC ingestion patterns (watermarks, change tables, log-based ingestion).
Advanced error handling & observability.
Excellent communication and teamwork abilities.
A passion for working with data and a desire to continuously learn and improve.
Excellent English skills.

Desired Qualifications

Ideally Experience with data virtualization tools (Denodo or Tableau).
Microsoft Azure or Databricks certifications are a plus.
German skills are a bonus.

Benefits

You'll supercharge your potential.
You'll find your career.
You'll find your spark.
All at a place that knows that helping its customers stay on top starts by putting its people first.

Skills

SQLPythonDatabricksTalendMicrosoft AzureDenodoTableau

#Data Engineer#Talend#Databricks#ETL

About HCLTech

Supercharging progress through technology and innovation

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…

See all open jobs at HCLTech Read more about HCLTech Website