Data Engineer II

Technology, Data & Digital · Data, AI & Analytics · Data Engineering

In short

Minerva Science and Analytics team is looking for an experienced Data Engineer to help synthesise data into knowledge across a large number of businesses. You will own and drive the design of scalable data systems, lead technical initiatives at the intersection of data engineering and AI, architecting solutions that process large-scale data, and mentor junior engineers.

Responsibilities

Design and architect AI-native infrastructure supporting real-time data processing for AI/ML inference, training, and continuous learning at scale.
Architect infrastructure for agentic AI systems with multi-agent orchestration, defining patterns and best practices for the team.
Drive GenAI-powered data quality, entity resolution, and metadata management strategies that raise the bar for data integrity.
Own end-to-end accountability for data governance ensuring privacy/security compliance across datasets in cluster and data lake.
Design and build self-service platforms with embedded governance, lineage, and discovery — enabling teams to independently access and trust data.
Define data contracts and API standards for reliable, versioned data consumption across downstream consumers.
Architect and optimise AWS infrastructure: EC2, Lambda, S3, Redshift, EMR balancing performance, reliability, and cost.
Design high-throughput, fault-tolerant pipelines supporting BI Engineers, data/applied scientists, and AI agents at scale.
Drive infrastructure-as-code best practices using CDK, establishing reusable patterns and deployment standards.
Mentor team members, conducting code reviews and elevating engineering standards.
Own operational health of critical pipelines, driving root cause analysis and long-term prevention strategies.
Author and maintain technical design documents, influencing architectural decisions across org.
Drive automation initiatives that reduce operational toil and enable non-linear scaling.

Requirements

3+ years of data engineering experience
4+ years of SQL experience
Experience with data modeling, warehousing and building ETL pipelines

Desired Qualifications

Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases).

Benefits

Our inclusive culture empowers Amazonians to deliver the best results for our customers.
If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.

Skills

SQLData ModelingETLAWSRedshiftS3AWS GlueEMRKinesisFireHoseLambdaIAMCDK

#Data Engineering#AI#Machine Learning#AWS#ETL#Data Governance#Data Quality

About Amazon

Earth's most customer-centric company

Amazon is guided by four principles: customer obsession rather than competitor focus, passion for invention, commitment to operational excellence, and long-term thinking. We are driven by the excitement of building technologies, inventing products, and providing services that change lives. We embrace new ways of doing things, make decisions quickly, and are not afraid to fail. We have the scope and capabilities of a large company, and the spirit and heart of a small one.\n\nTogether, Amazonians research and develop new technologies from Amazon Web Services to Alexa on behalf of our customers:…

See all open jobs at Amazon Read more about Amazon Website