GCP Senior Data Engineer

Technology, Data & Digital · Data, AI & Analytics · Data Engineering · DevOps

In short

We are seeking a Senior Data Engineer with extensive GCP expertise to design, build, and optimize scalable data solutions. The role involves developing high-performance data pipelines, ensuring data reliability, and supporting analytics initiatives by collaborating with data scientists, analysts, and business teams. Responsibilities include designing data architectures, leveraging GCP services like Dataflow and BigQuery, and ensuring data quality, governance, and security.

Responsibilities

Design, build, and maintain scalable and high-performance data pipelines on GCP.
Develop and manage modern data architectures for batch and real-time processing.
Implement reusable frameworks for data ingestion and transformation.
Leverage GCP services (Dataflow, BigQuery, Pub/Sub, Cloud Storage, Cloud SQL/Firestore).
Build and optimize data integration workflows.
Optimize storage and query performance on GCP data platforms.
Ensure cost optimization, performance tuning, and scalable data design.
Implement data quality checks, validation frameworks, and monitoring.
Ensure adherence to data governance, security, and compliance standards.
Partner with data scientists, analysts, and business stakeholders.
Translate business problems into technical data solutions.
Monitor, troubleshoot, and ensure high availability and performance of data pipelines.
Implement logging, alerting, and observability frameworks.
Provide technical leadership and mentorship to junior engineers.
Drive best practices in coding, architecture, and deployment.
Stay updated with the latest GCP innovations and data engineering best practices.
Proactively recommend improvements to enhance system performance and scalability.

Requirements

Bachelor’s or master’s degree in computer science, IT, or related field
5-6 + years of experience in data engineering
Strong exposure to GCP
Strong hands-on experience with Dataflow, Big Query, Pub/Sub
Strong hands-on experience with Cloud Storage, Cloud SQL, Fire store
Expertise in ETL/ELT processes
Expertise in Data warehousing & data modeling
Strong programming skills in Python, SQL

Desired Qualifications

GCP Certifications (Professional Data Engineer / Cloud Architect) (Preferred)
Experience with Big Data technologies (Hadoop, Spark) (Preferred)
Exposure to Machine Learning / AI workflows (Preferred)
Familiarity with DevOps practices & CI/CD pipelines (Preferred)

Skills

GCPDataflowBigQueryPub/SubCloud StorageCloud SQLFirestoneETLELTData WarehousingData ModelingPythonSQLHadoopSparkMachine LearningAIDevOpsCI/CD

#Data Engineering#GCP#BigQuery#Dataflow#Python#SQL#ETL#Data Warehousing#Data Modeling#Cloud#Hybrid

About HCLTech

Supercharging progress through technology and innovation

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…

See all open jobs at HCLTech Read more about HCLTech Website