Senior Data Engineer

Teknik, data och digitalt · Data, AI och analys · Data engineering · DevOps

I korthet

Volvo Group is seeking a Senior Data Engineer with 8+ years of experience to join their team in Bangalore, India. The role involves developing and optimizing data pipelines using Azure, Spark, and Databricks, and working with data scientists to drive analytics and AI initiatives for sustainable transport solutions. This is a permanent, full-time, on-site position.

Ansvarsområden

Build complex data pipelines in Microsoft Azure.
Optimize existing data pipelines.
Support building the infrastructure for optimal extraction, transformation, and loading of data from various sources to Azure.
Work closely with data analysts and data scientists to provide required data structures and enable new insights.
Provision resources on Azure.
Keep the data secure across end-to-end solutions.
Evaluate and improve existing data analytics solutions.
Develop competences, learn new tools and ways of working.

Krav

8+ years of experience as a Data Engineer with relevant education background.
Hands-on skills on Azure Data Analytics, Spark, Databricks (Cost Optimization Techniques, Cluster Optimization, Performance Tuning).
Strong hands-on ETL skills and experience in building data pipelines using Databricks (with good knowledge of spark) and orchestrating Data workloads on Azure Data Factory.
Experience working with AI Assistant tools (like Github Copilot) and implementing them in projects.
Passion for AI and willingness to mentor team members on using AI for productivity improvements.
Experience in handling real-time streaming/transactional data (preferably Spark-Streaming, Kafka/EventHubs/EventGrid/Stream Analytics/Service Bus etc.).
Significant experience in processing data in scripting languages (Python, Pyspark, Scala).
Working with Git and following Git workflow (Branching, Managing conflicts, etc.).
Proficiency with databases (like SQL server or Netezza).
Comfortable with DevOps (or DevSecOps) and able to provision resources in Azure.
Comfortable working in a diverse, complex, and fast-changing landscape of data sources.
Fluent communication in English.
Proactive problem solver with innovative thinking and a strong team player.

Önskade kvalifikationer

Good understanding of Volvo Data Marketplace.
Experience in AGILE project methodology and practice with ARM Templates/Bicep on the DevOps front.
Understanding the DevOps Architecture (Agent Pools, Accounts, Var Groups, Templating, etc.).
Knowledge of Azure Networking model (public and private connectivity, VNET injection, etc.).
Familiarity with Microsoft Power BI or other data visualization tools such as Qlik, SAP Business Objects.
Knowledge of other services and tools used to ETL workflows like Informatica IICS.
Familiarity with database management systems, online analytical processing (OLAP).

Förmåner

Being a part of a product team focusing both on maintenance and innovations.
A steep learning curve with a state of the art and individualized training program.
Collaborative environment.
Work-life balance.
Clear career path & extensive development opportunities such as mentoring or coaching programs.
Participation in international projects and different pieces of training.
Unlimited access to learning including Microsoft ESI training programs and certifications, Pluralsight, Udemy and many more.

Färdigheter

Azure Data AnalyticsSparkDatabricksETLAzure Data FactoryGithub CopilotSpark-StreamingKafkaEventHubsEventGridStream AnalyticsService BusPythonPysparkScalaGitSQL serverNetezzaDevOpsARM TemplatesBicepPower BIQlikSAP Business ObjectsInformatica IICSOLAP

#Data Engineering#Azure#Data Pipelines#DevOps#Big Data#Analytics

Om Volvo Group

The Volvo Group is one of the world’s leading manufacturers of trucks, buses, construction equipment and marine and industrial engines. The Group also provides complete solutions for financing and service. The Volvo Group, with its headquarters in Gothenburg, employs about 100,000 people, has production facilities in 18 countries and sells its products in more than 190 markets.\n\n

Se alla lediga jobb hos Volvo Group Läs mer om Volvo Group Webbplats