The Job

Data Consultant

Teknik, data och digitalt · Data, AI och analys · Data engineering

Gå med för uppdateringar

I korthet

Highly skilled Senior Data Engineer – Kafka Streaming sought to design, build, and support scalable real-time data solutions. This role focuses on Confluent Kafka, event-driven architecture, and real-time integration, partnering with various teams to build robust data platforms. Experience with streaming data pipelines, event architecture, and Confluent platform administration is essential.

Ansvarsområden

  • Design, develop, and maintain enterprise-scale streaming data pipelines using Confluent Kafka and related tools.
  • Build event-driven integrations between enterprise applications, operational systems, cloud platforms, and analytics environments.
  • Design Kafka topic structures, schemas, partitioning strategies, retention policies, and message contracts.
  • Develop real-time ingestion pipelines supporting operational analytics, AI, machine learning, and data product use cases.
  • Implement publish-subscribe, event sourcing, CDC, and streaming integration patterns.
  • Develop reusable frameworks and standards for event-driven application integration.
  • Partner with application and integration teams to define enterprise event architecture standards.
  • Ensure secure, reliable, and scalable movement of high-volume business-critical data across platforms.
  • Develop and support solutions utilizing the Confluent platform ecosystem.
  • Design and implement Kafka Connect integrations, connectors, and stream processing solutions.
  • Configure and optimize topics, brokers, replication factors, partitions, retention settings, and security controls.

Krav

  • 8+ years of experience in Data Engineering, Data Integration, or related disciplines.
  • 5+ years of hands-on experience with Confluent Kafka or Apache Kafka in enterprise environments.
  • Strong experience designing and supporting event-driven architectures and real-time data pipelines.
  • Experience implementing enterprise-scale streaming platforms supporting business-critical workloads.
  • Experience with Confluent Kafka, Kafka Connect, schema registry, Kafka streams, event-driven architectures, CDC, and real-time data integration.
  • Strong SQL and data transformation skills.
  • Experience with Snowflake or similar MPP databases.
  • Experience with Azure Data Factory, Azure Data Lake, Synapse, Microsoft Fabric, or equivalent cloud data platforms.
  • Strong understanding of dimensional modeling, medallion architecture, and semantic layer concepts.
  • Experience with API integration and modern integration architectures.
  • Familiarity with Python, Spark, Java, Scala, or other development languages used in streaming environments.
  • Experience with Agile delivery methodologies and product-oriented operating models.
  • Strong understanding of data quality frameworks, observability, monitoring, and operational excellence practices.

Förmåner

  • Supercharge your potential.
  • Find your career.
  • Find your spark.
  • A place that knows that helping its customers stay on top starts by putting its people first.
#Data Engineering#Data Integration#Kafka Streaming#Real-time Data Solutions#Event-Driven Architecture#Confluent Kafka#Snowflake#Azure#Microsoft Fabric#Agile
HCLTech Logo

Företag

HCLTech

Publicerade jobb

för 1 månad sedan

Anställningstyp

Heltid

Arbetsform

På plats

Erfarenhetsnivå

Senior

Platser

Bengaluru, India

Sökande

Ansök tidigt