Data Engineer I, DSP Analytics
Teknik, data och digitalt · Data, AI och analys · Data engineering · Business intelligence
I korthet
Amazon DSP Analytics team seeks a Data Engineer to design, build, and maintain data pipelines and ETL processes for actionable insights and GenAI applications. Requires 1+ years of data engineering experience with SQL, data modeling, and scripting languages like Python, with experience in big data technologies and AWS preferred.
Ansvarsområden
- Design, build, and maintain robust data pipelines to acquire, process, and store data from various sources.
- Develop and optimize ETL processes to clean, enrich, and structure raw data.
- Implement and manage data warehousing solutions for efficient data storage and retrieval.
- Establish data quality standards and perform data validation.
- Optimize data pipelines and storage solutions for large volumes of data.
- Ensure data privacy and security.
- Collaborate with data scientists, analysts, and stakeholders.
- Maintain documentation for data pipelines, data models, and processes.
- Implement monitoring solutions for data pipelines.
- Keep abreast of industry trends and emerging technologies in data engineering.
Krav
- 1+ years of data engineering experience
- Experience with SQL
- Experience with data modeling, warehousing and building ETL pipelines
- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)
- Experience with one or more scripting language (e.g., Python, KornShell)
- Knowledge of database, data warehouse, or data lake solutions
Önskade kvalifikationer
- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR
- Knowledge of basics of designing and implementing a data schema like normalization, relational model vs dimensional model
- Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
- Demonstrated experience leveraging generative AI tools to enhance workflow efficiency and productivity
- Ability to craft effective prompts and critically evaluate AI-generated outputs
- Experience identifying opportunities to integrate AI solutions into products and services
Förmåner
- Inclusive culture empowers Amazonians to deliver the best results for our customers.
#Data Engineering#Analytics#DSP#ETL#Data Warehousing#SQL#Python#Big Data#AWS#Generative AI