Data Engineer II
What is the Job like?
- Design, develop & maintain data platform services for varied use cases such as Data Extraction, Data Processing, Data Ingestion, Data Observability, and Data Discovery.
- Own and operate the analytical data warehouse/data lake.
- Manage the deployment of services onto multiple data centers across the globe.
- Enable performance monitoring and auto-scaling of the platform services.
- Contribute to establishing and enforcing coding & operational best practices for the team.
Who should apply?
- 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
- Excellent command of one or more programming languages, preferably Python or Java.
- Excellent SQL skills.
- Knowledge of Flink, Airflow.
- Knowledge of DBT.
- Experience working with Kubernetes.
- Strong knowledge of architecture & internals of Apache Spark with multiple years of hand-on experience.
- Experience working with distributed SQL engines like Athena / Presto.
- Experience in building ETL Data Pipelines.
- Ability to cut through the buzzwords and pick the right tools for building systems centred on core principles of reliability, scalability and maintainability