GCP Senior Data Lead
Technology, Data & Digital · Data, AI & Analytics · Data Engineering · Software Engineering
In short
We are seeking a Senior Data Engineer with deep expertise in Google Cloud Platform (GCP) to design, build, and optimize scalable data ecosystems and high-performance data pipelines. You will collaborate with stakeholders to translate business requirements into robust data solutions, ensuring data quality, governance, and security.
Responsibilities
- Design, build, and maintain scalable and high-performance data pipelines on GCP.
- Develop and manage modern data architectures for batch and real-time processing.
- Implement reusable frameworks for data ingestion and transformation.
- Leverage GCP services like Dataflow, Big Query, Pub/Sub, Cloud Storage, Cloud SQL/Fire store.
- Build and optimize data integration workflows.
- Optimize storage and query performance across GCP data platforms.
- Ensure cost optimization, performance tuning, and scalable data design.
- Implement robust data quality checks, validation frameworks, and monitoring mechanisms.
- Ensure adherence to data governance, security, and compliance standards.
- Partner with data scientists, analysts, and business stakeholders to understand requirements.
- Translate business problems into technical data solutions.
- Monitor, troubleshoot, and ensure high availability and performance of data pipelines.
- Implement logging, alerting, and observability frameworks.
- Provide technical leadership and mentorship to junior engineers.
- Drive best practices in coding, architecture, and deployment.
- Stay updated with the latest GCP innovations and data engineering best practices.
- Proactively recommend improvements to enhance system performance and scalability.
Requirements
- Strong hands-on experience with Dataflow, Big Query, Pub/Sub.
- Strong hands-on experience with Cloud Storage, Cloud SQL, Fire store.
- Expertise in ETL/ELT processes.
- Expertise in Data warehousing & data modeling.
- Strong programming skills in Python and SQL.
- Strong analytical and problem-solving skills.
- Attention to detail and commitment to data accuracy.
- Ability to work independently and in cross-functional teams.
- Excellent communication and stakeholder management skills.
- Bachelor’s or master’s degree in computer science, IT, or related field.
- 8+ years of experience in data engineering, with strong exposure to GCP.
Desired Qualifications
- GCP Certifications (Professional Data Engineer / Cloud Architect)
- Experience with Big Data technologies (Hadoop, Spark)
- Exposure to Machine Learning / AI workflows
- Familiarity with DevOps practices & CI/CD pipelines
#GCP#Data Lead#Data Engineer#Google Cloud Platform#Data Pipelines#Data Architecture#Data Integration#Data Management#Data Governance#Data Quality#Cloud Storage#BigQuery#Dataflow#Pub/Sub#Cloud SQL#Firestore#ETL#ELT#Data Warehousing#Data Modeling#Python#SQL#Machine Learning#AI#DevOps