The Job

Data Engineer II, Prime Video Advertising

Teknik, data och digitalt · Data, AI och analys · Data engineering

Gå med för uppdateringar

I korthet

Prime Video Advertising is seeking a skilled Data Engineer II in Karnataka, India, to design, build, and maintain scalable data pipelines using AWS and internal tools. Responsibilities include data ingestion, transformation, quality assurance, data governance, and optimizing big data solutions. The role requires collaboration with various teams and a strong understanding of data engineering best practices.

Ansvarsområden

  • Design and implement scalable, fault-tolerant data pipelines using AWS technologies and internal Amazon tools to extract, transform, and load data from multiple sources.
  • Collaborate cross-functionally with BIEs, Data Scientists, PMs, and SDEs to understand data requirements and deliver customized data solutions.
  • Automate infrastructure deployment with CI/CD pipelines and ensure streamlined processes for deployment and maintenance.
  • Ensure data quality through robust validation, cleansing, and deduplication techniques.
  • Implement data governance standards, including access control, encryption, data retention, deletion policies, and audit mechanisms to ensure compliance and security.
  • Continuously improve and optimize data pipelines and infrastructure, staying up to date with emerging technologies and implementing automation and monitoring tools.
  • Build a scalable and reliable data platform supporting analytics and experimentation for intuitive, self-service data products.
  • Write high quality code and build scalable applications that interface with critical services and APIs to extract and process unstructured data.
  • Work with a range of data technologies, including Python, EMR, Spark, Iceberg, Airflow, and many AWS data services like Glue, Athena, Redshift to create end-to-end pipelines that consolidate data from disparate systems.

Krav

  • Bachelor's degree
  • 3+ years of data engineering experience
  • Experience with data modeling, warehousing and building ETL pipelines
  • Experience with SQL
  • Knowledge of professional software engineering & best practices for full software development life cycle, including coding standards, software architectures, code reviews, source control management, continuous deployments, testing, and operational excellence
  • Knowledge of distributed systems as it pertains to data storage and computing
  • Knowledge of batch and streaming data architectures like Kafka, Kinesis, Flink, Storm, Beam
  • Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasets
  • Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS
  • Experience with Apache Spark / Elastic Map Reduce

Önskade kvalifikationer

  • Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
  • Experience with non-relational databases / data stores (object storage, document or key-value stores, graph databases, column-family databases)
  • Master's degree in computer science, engineering, analytics, mathematics, statistics, IT or equivalent
  • Experience programming with at least one modern language such as C++, C#, Java, Python, Golang, PowerShell, Ruby
  • Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets

Förmåner

  • Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
  • Our inclusive culture empowers Amazonians to deliver the best results for our customers.
  • If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.
  • If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
#Data Engineer#Prime Video#Advertising#AWS#Big Data#ETL#Data Pipelines
Amazon Logo

Företag

Amazon

Publicerade jobb

för 1 månad sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Mellannivå

Platser

Bengaluru, India

Kvalifikation

Kandidatexamen

Sökande

Ansök tidigt