Job Description
As a Data Engineer you will be responsible as the expert for formulating delivery of technical and functional data support activity to prospective clients and customers while ensuring customer satisfaction. The role focuses on creating value chain to help address the challenges of acquiring the large complex data, evaluating its value, distilling, and analyzing. This individual will be responsible to develop robust, scalable, and maintainable data systems with a combination of in-house tools and standard technologies.
Preferred Qualifications
- 5+ years' experience in the field
- Programming skills using Python, Java, SQL, R
- Experience with big data technologies such as Spark, Hadoop, Hive, HBase, Pig, etc
- Background in Oracle application workload preferred: Oracle DB, MySQL, Oracle Fusion
- Experience with data modeling, data warehousing, and building ETL pipelines
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
Additional Details
- Good knowledge in data engineering concepts, data architecture design, performance tuning, and data modeling advanced ability to perform exploratory data analysis and data visualization skills
- Comfortable working independently in an ambiguous and fast-paced environment, and are able to think big while paying attention to detail
- They can communicate with both technical experts and non-experts, and have an analytical mindset that helps them connect their work to the needs of their data customers
- Define and manage SLA for all data sets in allocated areas of ownership
- Collaborate with engineers, product managers, and data scientists to understand data needs, representing key data insights in a meaningful way
- Design, build, and launch collections of sophisticated data models and visualizations that support multiple use cases across different products or domains
- Solve our most challenging data integration problems, utilizing optimal ETL patterns, frameworks, query techniques, sourcing from structured and unstructured data sources
- Assist in owning existing processes running in production, optimizing complex code through advanced algorithmic concepts
- Partner with product, analytics, and data engineering in interpreting business and analytics requirements and converting them into robust data pipelines
General Skill Requirements:
- Strong drive to learn and master new technologies and techniques.
- Work with fellow data scientists & architects to build out and maintain all parts of the services lifecycle
- Ability to work independently and with team members from different backgrounds
- Ability to quickly understand challenging business problems and uses cases across industries, finding patterns and insights within structured and unstructured data across industries, like financial, agricultural, transportation, food, manufacturing, logistics, energy and other industries.
- Ability to communicate complex data in a simple, actionable way
Responsibilities
As a member of the software engineering division, you will assist in defining and developing software for tasks associated with the developing, debugging or designing of software applications or operating systems. Provide technical leadership to other software developers. Specify, design and implement modest changes to existing software architecture to meet changing needs.