Platform Engineer III

Technology, Data & Digital · Data, AI & Analytics · Data Engineering

In short

As a Data Engineer III with over 6 years of experience, you will build and optimize ELT/ETL pipelines using BigQuery, GCS, Dataflow, PubSub, and Composer/Airflow, primarily with Python. This role involves working with data warehouses, implementing data quality procedures, and exploring new GCP services to enhance project contributions.

Responsibilities

Build and optimize ELT/ETL Pipelines using BigQuery, GCS, Dataflow, PubSub and Orchestration services Composer/Airflow
Build ETL/ELT Pipelines with developing software code in Python
Develop and implement data quality and governance procedures to ensure the accuracy and reliability of data
Eager to learn and explore new services within GCP to enhance skills and contribution to Projects
Coach junior data engineering personnel and help them get better understanding of overall Data ecosystem
Work on Solution deck, IP build, client meetings on requirement gathering

Requirements

6+ years experience as a Data Engineer
Hands-On experience in building ETL/ELT Pipelines with developing software code in Python
Experience in working with data warehouses, data warehouse technical architectures, reporting/analytic tools
Demonstrate extensive skills and success in the implementation of technology projects within a professional environment, with a particular focus on data engineering
Demonstrated excellent communication, presentation, and problem-solving skills.
Prior Experience in ETL tool such as DBT,Talend Etc
Knowledge in architecture principles, guidelines and standards
Data Warehousing
Programming Language: Python, SQL
Big Data
Data Analytics
Experience in Building Streaming and Batch data pipelines with GCP services
Experience in designing & implementing solution in mentioned areas: Cloud Storage, BigQuery, Data Flow, DataProc, PubSub, Data Fusion, Cloud Function, Composer etc
Working Experience with Agile methodologies and CI/CD Tools like Terraform/Jenkins

Desired Qualifications

Good to have skills: AI/ML, Gen AI Background
Good to have skills: IAM, Cloud Logging and Monitoring
Optional but valuable: Certification in VLSI Design or related EDA tool certifications (Cadence Certified, Synopsys Certified)

Benefits

Supercharge your potential
Find your career
Find your spark
A place that knows that helping its customers stay on top starts by putting its people first
Global technology company, home to more than 230,000 people across 60 countries
Delivering industry-leading capabilities centered around digital, engineering, cloud and AI
Work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services

Skills

PythonSQLBigQueryGCSDataflowPubSubComposerAirflowData WarehousingETLELTDBTTalendData AnalyticsCloud StorageDataProcData FusionCloud FunctionAI/MLGen AIIAMCloud LoggingCloud MonitoringAgileCI/CDTerraformJenkins

#Data Engineer#BigQuery#GCP#Python#SQL#ETL#ELT#Data Warehousing#Cloud

About HCLTech

Supercharging progress through technology and innovation

HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…

See all open jobs at HCLTech Read more about HCLTech Website