GCP Senior Data Lead
Technology, Data & Digital · Data, AI & Analytics · Data Engineering
In short
We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) to design, build, and optimize scalable data ecosystems. This role will develop high-performance data pipelines and support enterprise-wide analytics initiatives, collaborating with cross-functional teams.
Responsibilities
- Design, build, and maintain scalable and high-performance data pipelines on GCP.
- Develop and manage modern data architectures for batch and real-time processing.
- Implement reusable frameworks for data ingestion and transformation.
- Build and optimize data integration workflows using GCP services (Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL/Firestore).
- Optimize storage and query performance, and ensure cost optimization on GCP data platforms.
- Implement robust data quality checks, validation frameworks, and monitoring mechanisms.
- Ensure adherence to data governance, security, and compliance standards.
- Partner with data scientists, analysts, and business stakeholders to deliver actionable insights.
- Translate business problems into technical data solutions.
- Monitor, troubleshoot, and ensure high availability and performance of data pipelines.
- Provide technical leadership and mentorship to junior engineers.
- Drive best practices in coding, architecture, and deployment.
- Stay updated with the latest GCP innovations and data engineering best practices.
- Proactively recommend improvements to enhance system performance and scalability.
Requirements
- Strong hands-on experience with Dataflow, BigQuery, Pub/Sub.
- Strong hands-on experience with Cloud Storage, Cloud SQL, Firestore.
- Expertise in ETL/ELT processes.
- Expertise in Data warehousing & data modeling.
- Strong programming skills in Python and SQL.
- Strong analytical and problem-solving skills.
- Attention to detail and commitment to data accuracy.
- Ability to work independently and in cross-functional teams.
- Excellent communication and stakeholder management skills.
- Bachelor’s or master’s degree in computer science, IT, or related field.
- 8+ years of experience in data engineering with strong exposure to GCP.
Desired Qualifications
- GCP Certifications (Professional Data Engineer / Cloud Architect) preferred.
- Experience with Big Data technologies (Hadoop, Spark) preferred.
- Exposure to Machine Learning / AI workflows preferred.
- Familiarity with DevOps practices & CI/CD pipelines preferred.
Benefits
- Supercharge your potential.
- Find your career.
- Find your spark.
- HCLTech knows that helping its customers stay on top starts by putting its people first.
#GCP#Data Engineering#Data Pipelines#Big Data#Cloud