Apache Spark Technical Specialist - Scala, Python
Technology, Data & Digital · Data, AI & Analytics · Data Engineering · Software Engineering
In short
Responsibilities
- Support the delivery of modern data solutions and reporting capabilities across Insurance Finance.
- Build, enhance, and support strategic data products that enable critical Finance processes and decision-making.
- Develop data solutions primarily using Scala and Apache Spark on Google Cloud Platform (GCP).
- Leverage modern cloud-native technologies including BigQuery, DataProc, GCS, and automated CI/CD pipelines.
- Contribute to enhancements and support activities across existing platforms.
- Work closely with Finance, Accounting, Risk, and Engineering colleagues to solve complex business problems.
- Apply practical and scalable data engineering solutions.
Requirements
- Computer Science, Software Engineering or related degree, or equivalent industry experience.
- Experience developing and supporting data solutions using Apache Spark and distributed processing frameworks.
- Experience developing applications in Scala or another object-oriented/JVM-based programming language.
- Strong understanding of software engineering principles including testing, code quality and maintainability.
- Experience with unit testing frameworks such as Xray or equivalent.
- Experience delivering solutions on Google Cloud Platform (GCP).
- Strong SQL and Python skills for data analysis, troubleshooting, optimisation and data profiling.
- Experience working with BigQuery and large-scale analytical datasets.
- Familiarity with CI/CD and DevOps tooling including Maven, Git, Nexus, SonarQube, Harness and automated deployment pipelines.
- Experience using JIRA and Confluence to manage Agile delivery and technical documentation.
- Experience working within Agile teams using Scrum, sprint planning and iterative delivery practices.
- Strong communication and stakeholder management skills.
- Demonstrable ability to apply practical problem-solving techniques to real-world business and data challenges.
Desired Qualifications
- Experience with DataProc, Cloud Composer, GCS or other GCP data services.
- Experience within Financial Services, particularly Finance, Insurance, Regulatory Reporting or Risk data domains.
- Knowledge of modern data platform architectures and cloud migration programmes.
- Experience supporting production platforms and investigating data or operational issues.
- Exposure to DevOps, platform engineering or infrastructure-as-code practices.
- Previous experience with SAS, particularly in reporting, analytics or legacy platform support.
Benefits
- Opportunity to work for the UK's largest Retail, Digital and Mobile bank.
- Continued investment in cloud, data platforms, artificial intelligence and automation.
- Work within a cloud-first environment.
- Commitment to creating an inclusive environment where colleagues can thrive.
- Active support for diversity across all backgrounds and experiences.
- Proud to offer reasonable adjustments throughout our recruitment process.
Skills
About HCLTech
Supercharging progress through technology and innovation
HCLTech is a global technology company, home to 219,000+ people across 54 countries, delivering industry-leading capabilities centered around digital, engineering and cloud, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending September 2022 totaled $12.1 billion. To learn how we can supercharge progress for…
Company
HCLTechJob Posted
3 days ago
Employment Type
Full Time
Work mode
Remote
Experience Level
Mid-Senior
Locations
Chennai, India
Qualification
Applicants
Be an early applicant