The Job

Data Engineer

Teknik, data och digitalt · Data, AI och analys · Data engineering

Gå med för uppdateringar

I korthet

Microsoft Digital is seeking a Data Engineer to build and evolve data platforms that transform operational and business data into trusted data products. You will work with technologies like Microsoft Fabric, Spark, and Azure data services to support reporting, analytics, and AI-assisted experiences. This hybrid role requires 4+ years of experience in data pipeline development, ETL/ELT processes, and SQL/Python proficiency.

Ansvarsområden

  • Design, develop, and maintain scalable data pipelines, transformations, and models.
  • Build and operate data solutions using Microsoft Fabric, OneLake, Spark, Power BI, and Azure data services.
  • Ingest and curate data across support and field-service domains.
  • Design dimensional models and reusable semantic models.
  • Establish data products supporting reporting, analytics, automation, and natural-language data experiences.
  • Create scalable processes for onboarding new data fields.
  • Implement automated data-quality controls.
  • Develop and improve metadata-management capabilities.
  • Partner with business stakeholders and engineering teams to translate requirements into technical solutions.
  • Define stable, secure, and well-documented data contracts.
  • Implement security and governance controls.
  • Improve platform performance, processing efficiency, and cost efficiency.
  • Contribute to deployment automation, CI/CD pipelines, and operational tooling.
  • Support live-site operations by investigating data issues and implementing corrective actions.
  • Build monitoring and observability for pipelines and data models.
  • Analyze report, measure, and column usage to identify redundant assets.
  • Collaborate across teams to share best practices and drive adoption of modern data engineering capabilities.

Krav

  • SQL/Advanced SQL, Python, PySpark, ETL/ELT, Data Modeling, Data Transformation, Incremental Processing, Error Handling, Scalability, Edge Cases, Performance Optimization.
  • Microsoft Fabric, OneLake, Lakehouse, Warehouse, Delta Tables, Batch & Streaming Pipelines, Spark Optimization, Security, Row-Level Security (RLS), Data Governance.
  • 4+ years experience designing, developing, or operating production data pipelines and ETL/ELT processes.
  • Experience implementing CI/CD and automated deployment processes for cloud data platforms.
  • Proficiency in SQL and at least one data engineering language or framework (Python, PySpark, Spark, Scala).
  • Understanding of data warehousing, dimensional modeling, and analytical data-consumption patterns.
  • Experience implementing data validation, testing, monitoring, and operational support for production data solutions.
  • Experience translating business requirements into scalable technical designs and data products.
  • Demonstrated ability to collaborate with engineering teams, product/program managers, business stakeholders, and data consumers.
  • Experience building enterprise data solutions with Microsoft Fabric (OneLake, Lakehouse, Warehouse, notebooks, pipelines, Dataflows Gen2, Direct Lake).
  • Knowledge of enterprise security and governance practices (role-based access control, row-level security, privacy, auditing, retention).
  • Knowledge of Microsoft Fabric capacity management, performance tuning, and cloud cost optimization.

Önskade kvalifikationer

  • Familiarity with preparing curated, documented data for downstream natural-language analytics or AI-assisted applications.
  • Experience developing and maintaining Power BI semantic models, including DAX, shared business definitions, and model optimization.
  • Knowledge of Delta Lake, medallion architecture, schema evolution, and reusable data-product or data-contract patterns.
  • Familiarity with Microsoft Purview or comparable metadata catalog, lineage, and governance capabilities.
  • Experience supporting business-critical data platforms through live-site incident response, root-cause analysis, and resiliency improvements.
  • Experience modernizing or rationalizing a large reporting and analytics estate.
  • Familiarity with enterprise support, customer experience, service management, finance, or field-service data.
  • LLM Fundamentals, Tool/Function Calling, RAG, SQL Grounding, Agent Orchestration, SDK/API Design, Evaluation Frameworks, Guardrails, Responsible AI.

Förmåner

  • Flexibility through Microsoft’s hybrid work model.
  • Opportunity to deepen expertise in modern data engineering.
  • Work with Microsoft’s latest data technologies.
  • Collaborate directly with engineering and business leaders.
  • Influence how data is used across one of the world’s largest enterprise environments.
#Data Engineering#Microsoft Fabric#Data Platform#ETL#Data Modeling#Power BI#Azure#SQL#Python
Microsoft Logo

Företag

Microsoft

Publicerade jobb

för 1 månad sedan

Anställningstyp

Heltid

Arbetsform

Hybrid

Erfarenhetsnivå

Mellannivå

Platser

United States

Sökande

Ansök tidigt