Big Data Engineer at OCTAVE
Applications are invited for all candidates to fill the Big Data Engineer Job Opening at OCTAVE
Closing Date : 24/12/2021
The Big Data Engineers will help in developing high performance & high scalability enterprise applications using one or more leading cloud platforms across SaaS and PaaS. They will be working closely with the data architects to jointly develop the data architecture and ensure security and maintenance. Their role also involves diagnosis of existing architecture and data maturity and help the organization in identifying gaps and possible solutions. They will also work with data scientists and business leadership to develop data pipelines for model development and productionalization. Their work will involve high level of interface with business heads and corporate leadership.
Key responsibilities
- Gather requirements, assess gaps and build roadmaps and architectures
- Lead teams of 2-3 associate data engineers in the project building and delivery process
- Explore suitable options, design, and create data pipelines (data lake / data warehouses) for specific analytical solutions
- Define ETL / ELT based on jointly defined requirements
- Identify gaps and implement solutions for data security, quality and automation of processes
- Support maintenance, bug fixing and performance analysis along data pipeline
- Build and manage cloud data services
Desired Skills / Competencies
Education + Technical skills / experience
- Bachelor's degree in Computer Science, Engineering, Mathematics or Statistics. Master's degree preferred
- 4+ years of experience in data engineering field
- Good knowledge of Python or at least 1 programming language
- Basic understanding of Microsoft Azure or other leading cloud platforms
- Limited understanding of maintaining and configuring data engineering and ETL tools (e.g., Informatica, Azure Data Factory, SSIS)
- Hands on experience in working with Spark and Azure Data bricks
- Basic understanding of data tools such as Hive, Spark, Hadoop, or Presto
Managerial Skills
- Ability to work well in agile environments in diverse teams with multiple stakeholders
- Strong project management and organizational skills
- Ability to effectively communicate complex analytical and technical content
Mindset & Behavior
- High energy and passionate individual who inspires teammates to reach their
- maximum potential
- Excited about trying new solutions outside standard approved
- Willing to adopt an iterative approach; experimental mindset to drive innovation
Apply now : https://bit.ly/3DQpozX
