GCP Senior Data Engineer
Technology, Data & Digital · Data, AI & Analytics · Data Engineering
In short
We are seeking a Senior Data Engineer with extensive experience in Google Cloud Platform (GCP) to design, build, and optimize scalable data pipelines and architectures. This role involves collaborating with various teams to ensure data reliability, quality, and performance for enterprise-wide analytics initiatives.
Responsibilities
- Design, build, and maintain scalable and high-performance data pipelines on GCP.
- Develop and manage modern data architectures for batch and real-time processing.
- Implement reusable frameworks to standardize data ingestion and transformation processes.
- Leverage GCP services like Dataflow, BigQuery, Pub/Sub, Cloud Storage, and Cloud SQL/Firestore.
- Optimize storage and query performance across GCP data platforms.
- Ensure cost optimization, performance tuning, and scalable data design.
- Implement robust data quality checks, validation frameworks, and monitoring mechanisms.
- Ensure adherence to data governance, security, and compliance standards.
- Partner with data scientists, analysts, and business stakeholders to understand requirements and deliver actionable insights.
- Translate business problems into technical data solutions.
- Monitor, troubleshoot, and ensure high availability and performance of data pipelines.
- Implement logging, alerting, and observability frameworks.
- Provide technical leadership and mentorship to junior engineers.
- Drive best practices in coding, architecture, and deployment.
- Stay updated with the latest GCP innovations and data engineering best practices.
- Proactively recommend improvements to enhance system performance and scalability.
Requirements
- Bachelor’s or master’s degree in computer science, IT, or related field.
- 5-6+ years of experience in data engineering.
- Strong exposure to GCP.
- Strong hands-on experience with Dataflow, BigQuery, Pub/Sub.
- Strong hands-on experience with Cloud Storage, Cloud SQL, Firestore.
- Expertise in ETL/ELT processes.
- Expertise in Data warehousing & data modeling.
- Strong programming skills in Python and SQL.
Desired Qualifications
- GCP Certifications (Professional Data Engineer / Cloud Architect).
- Experience with Big Data technologies (Hadoop, Spark).
- Exposure to Machine Learning / AI workflows.
- Familiarity with DevOps practices & CI/CD pipelines.
Benefits
- Opportunity to supercharge your potential.
- Find your career.
- Find your spark.
- A place that knows that helping its customers stay on top starts by putting its people first.
#GCP#Data Engineering#Data Pipelines#Big Data#Cloud