Data Engineer II

Technology, Data & Digital · Data, AI & Analytics · Data Engineering

In short

The Amazon ShipTech Analytics organization seeks an ambitious Data Engineer II to develop analytical tools and data processing solutions for the Amazon transportation business. This role involves building end-to-end data pipelines, utilizing large datasets for analytics and ML, and evaluating big-data technologies. The ideal candidate has experience in data modeling, ETL design, cloud/big-data technologies, and possesses strong SQL and scripting skills.

Responsibilities

Build end-to-end data pipelines to ingest and transform data from different types of data sources and systems; from traditional ETL pipelines to event data streams
Utilize data from disparate data sources to build meaningful datasets for analytics, reporting and ML use cases
Evaluate and implement various big-data technologies and solutions (e.g. Redshift, Hive/EMR, Spark, SNS, SQS, Kinesis) to optimize processing of extremely large datasets
Understand and analyze business processes, logical data models and relational database implementations
Write high performing and optimized SQL queries
Execute research projects, and generate practical results and recommendations
Design and implement automated data processing solutions and data quality controls

Requirements

Bachelor's degree
3+ years of data engineering experience
3+ years of SQL experience
Experience with data modeling, warehousing and building ETL pipelines
Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)

Desired Qualifications

Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
5+ years of data engineering experience
Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions

Skills

SQLPythonJavaScalaNodeJSHadoopHiveSparkEMRRedshiftS3AWS GlueKinesisFireHoseLambdaIAMSNSSQS

#Data Engineer#ETL#Data Modeling#Big Data#SQL#Python#AWS

About Amazon

Earth's most customer-centric company

Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. We are driven by the excitement of building technologies, inventing products, and providing services that change lives. We embrace new ways of doing things, make decisions quickly, and are not afraid to fail. We have the scope and capabilities of a large company, and the spirit and heart of a small one.\n\nTogether, Amazonians research and develop new technologies from Amazon Web Services to Alexa on behalf of our customers:…

See all open jobs at Amazon Read more about Amazon Website