ADF Senior Technical Specialist

Technology, Data & Digital · Data, AI & Analytics · Data Engineering · Cloud Engineering

Smart Summary

AI-generated overview of this position

This role is for a highly skilled Databricks Platform Specialist to manage and optimize an enterprise data ecosystem on AWS. The specialist will be responsible for Databricks workspace administration, governance, data integrations, security, and cost-effectiveness, ensuring a scalable and observable architecture. Key responsibilities include hands-on experience with Databricks administration, Unity Catalog, IaC, CI/CD, monitoring, and connecting various data sources.

Job Summary

Highly skilled Databricks Platform Specialist to oversee, secure, and optimize our enterprise data ecosystem on AWS.In this role, you will be the core architect of our Databricks workspace administration, governance framework, and multi-source data integrations.You will bridge the gap between infrastructure automation and data engineering, ensuring our medallion architecture is scalable,highly secure, cost-effective, and fully observable.

Key Responsibilities

Key Responsibilities:Strong hands-on experience with Databricks Platform Engendering and Administration Disaster Recovery - Multi region Workspace Management Unity Catalog Management - Familiarity with Unity Catalog and Databricks governance features. User Management Governance & Security Infrastructure as Code (IaC) & Automation - CI/CD Optimization, Monitoring & Operations Dashboards - Cost monitoring Data source connections - Data bricks, Informatica, sap Analytics[cloud] and other different data sources Genie spaces, Databricks applications Mosaic AI Agent Framework/ Model Training

Skill Requirements

Strong hands-on experience with Databricks on AWS, including Delta Lake and S3.Proficiency in Python and SQL for data engineering tasks.Experience working within a medallion architecture framework.Experience with model monitoring, alerting, and pipeline observability.Strong documentation and communication skills.Ability to quickly integrate into an existing team and architecture.Familiarity with data privacy, compliance, and security best practices in cloud environments

Other Requirements

Strong hands-on experience with Databricks on AWS, including Delta Lake and S3.Proficiency in Python and SQL for data engineering tasks.Experience working within a medallion architecture framework.Experience with model monitoring, alerting, and pipeline observability.Strong documentation and communication skills.Ability to quickly integrate into an existing team and architecture.Familiarity with data privacy, compliance, and security best practices in cloud environments

#databricks#aws#data-engineering#cloud-computing#senior-technical-specialist#hyderabad-jobs#india-jobs#data-governance#automation#security