Platform Engineer II

Technology, Data & Digital · Data, AI & Analytics · Data Engineering

In short

Data Engineer II (5+ years experience) role at HCLTech in Gautam Buddha Nagar, Uttar Pradesh, focusing on building and optimizing ELT/ETL pipelines using GCP services like BigQuery, Dataflow, and Composer. Requires strong Python, SQL skills, experience with data warehousing, and a willingness to learn new GCP services.

Responsibilities

Build and optimize ELT/ETL Pipelines using BigQuery, GCS, Dataflow, PubSub and Composer/Airflow.
Develop and implement data quality and governance procedures.
Enhance skills and contribution to Projects by learning new GCP services.
Coach junior data engineering personnel.
Work on Solution decks, IP builds, and client meetings for requirement gathering.

Requirements

5+ years of experience as a Data Engineer.
Hands-on experience in building ETL/ELT Pipelines with software code in Python.
Experience working with data warehouses, technical architectures, and reporting/analytic tools.
Knowledge in architecture principles, guidelines, and standards.
Proficiency in Python and SQL.
Experience in building Streaming and Batch data pipelines with GCP services.
Experience in designing & implementing solutions in Cloud Storage, BigQuery, Data Flow, DataProc, PubSub, Data Fusion, Cloud Function, Composer.
Strong communication, presentation, and problem-solving skills.

Desired Qualifications

Prior experience in ETL tools such as DBT, Talend.
AI/ML, Gen AI background.
Experience with IAM, Cloud Logging and Monitoring.
Working experience with Agile methodologies and CI/CD tools like Terraform/Jenkins.
Analytical, client-first mindset.
Leadership and stakeholder management skills.
Ability to work in a global, fast-paced environment.

Benefits

Opportunity to supercharge potential and find career spark.
Work at a place that puts people first.
Be part of a global technology company with industry-leading capabilities.
Work with clients across all major verticals.

Skills

BigQueryGCSDataflowPubSubComposerAirflowPythonSQLDBTTalendDataProcData FusionCloud FunctionAI/MLGen AIIAMCloud LoggingCloud MonitoringTerraformJenkins

#Data Engineering#ETL#ELT#BigQuery#GCP#Python#SQL#Data Warehousing#Cloud#Agile

About HCLTech

Supercharging progress through technology and innovation

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…

See all open jobs at HCLTech Read more about HCLTech Website