Python Senior Technical Lead - Data Analysis, SQL
Technology, Data & Digital · Data, AI & Analytics · Data Engineering
In short
Seeking a Python Senior Technical Lead in Pune, India, to design and build a data platform using Java, Cloud, and Data Warehouse technologies. The role involves leading the Data Mesh architecture, hands-on Databricks and AWS services, and ensuring operational readiness for a major technology transformation program.
Responsibilities
- Leading the design process of building and evolving data domains on the data platform.
- Perform technical lead duties within the Data Platform Integration domain scrum.
- Ensuring all resiliency, observability, supportability, security, and operational readiness requirements are met.
- Acting as a Data domain SME and point of contact and escalation for the development team.
- Producing and maintaining application code and unit testing code.
- Produce and review development plans.
- Manage development issues, escalating when appropriate.
- Attend project meetings representing the Development team.
- Undertake Peer reviews.
- Act as a reference point for technical queries within the Development area.
- Promote technical best practices.
- Coaching, mentoring, and Quality assurance of the development team.
- Providing 3rd line support for applications supported by the development team.
Requirements
- Ability to be forward-thinking, analyse and anticipate project, technology and team solutions to ensure successful project delivery.
- Ability to take ownership of a technical solution, build new things without needing close supervision, learn and apply new tools and technologies, solve problems without needing constant help, make consistent daily progress on design and build.
- Directly involved in driving a Data Mesh architecture / design.
- Hands-on Databricks expertise.
- Hands-on experience with ETL tools such as AWS Glue / DBT.
- Strong knowledge of AWS services (Lambda, Glue, ECS, Step Functions, IAM roles, Lakeformation, EventBridge, SNS, SQS, EC2, Security Groups, Cloudformation, VPC, Cloud Watch, AWS Auto Scaling, Cloud Trail, Service Catalog, Fargate).
- Promotes an automated deployment approach through dev/ops pipelines, ideally using Gitlab.
- Demonstrable working knowledge on different file formats like XML, JSON, Parquet, Iceberg, AVRO.
- Hands-on experience in developing applications using Python/PySPARK.
- Understanding of core AWS services, uses, and AWS architecture best practices with in-depth knowledge of AWS cloud services like Compute, Network, Storage, and Identity & access management.
- Exposure working with Data Warehousing / Big Data applications.
- Experience with event-driven and real-time architecture patterns, messaging and streaming technologies such as Kafka, Kinesis and AWS Managed Services for Kafka.
- Experience of full development lifecycle.
- A strong analytical mind.
- Strong understanding of industry standards / best practices related to Cloud and serverless technology.
- Must be a strong computer scientist with a good appreciation of data structures and other fundamentals.
#Python#Data Analysis#SQL#Technical Lead#Data Platform#Data Mesh#Databricks#ETL#AWS#Cloud