Data Engineer - II, LMAQ-DE
Technology, Data & Digital · Data, AI & Analytics · Data Engineering · Business Intelligence
In short
Amazon's Last Mile Data Engineering Team is seeking a Data Engineer II in Hyderabad to design, develop, and deploy large-scale data warehouse and data lake solutions. This role involves building efficient data models and ETL pipelines for business intelligence and decision-making, working with massive datasets on a cloud-based platform.
Responsibilities
- Design, develop, troubleshoot, evaluate, deploy, and document data warehouse/data lake solutions.
- Build efficient, flexible, extensible, and scalable data models, ETL designs, and data integration services.
- Support and manage the growth of data solutions.
- Work with diverse teams, including business owners, to define key business questions and build datasets to answer them.
- Develop and operate large-scale data structures for business intelligence analytics using ETL/ELT processes.
- Build and operate highly available, distributed systems for data extraction, ingestion, and processing of large datasets.
- Leverage AWS and big data technologies to build complex ETL pipelines and near-real-time data ingestion systems.
- Drive innovation through Generative AI-powered solutions.
Requirements
- 3+ years of data engineering experience
- 4+ years of SQL experience
- Experience with data modeling, warehousing, and building ETL pipelines
- 2+ years of developing and operating large-scale data structures for business intelligence analytics using ETL/ELT processes
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
- Excellent written and verbal communication skills
Desired Qualifications
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
- Self-starter and able to learn on the go.
- Passionate about working with huge data sets and bringing datasets together to answer business questions and drive change.
Benefits
- Opportunity to work on rapidly expanding Amazon initiative.
- Opportunity to redefine how packages are delivered to Amazon customers.
- Work with large-scale, high-volume, high-performance data integration and delivery services.
- Work in one of the largest cloud-based data lakes.
- Inclusive culture empowers Amazonians to deliver the best results.
#data engineering#data warehouse#data lake#ETL#AWS