Data Engineer
ADA
Colombo

Data Engineer at ADA

Applications are invited for all candidates to fill the Data Engineer Job Opening at ADA

Closing Date : 31/01/2022

We're looking for an experienced Data engineer who will excel in a fast-paced setting and increase the velocity of new features development. The ideal candidate will have a demonstrated affinity for engineering best practices, data management fundamentals, data storage principles, and be current on recent advances in distributed systems as it pertains to data storage and computing.

What you will do?

• Be responsible for designing, building, and maintaining an efficient, extensible, and scalable data pipelines for processing high-volume and high-velocity data
• Collaborate with DevOps engineers, machine learning engineers, product managers, and technical partner teams to prepare and provide high quality data for data science and machine learning work
• Perform data management and governance to ensure its quality and constantly making improvements

What skills and experience you will need?

• Understanding of big data processing tools such as Spark and Airflow
• Knowledge of machine learning and deep learning algorithms
• Solid understanding of data structures and algorithms, no-SQL databases etc.
• 3+ years of experience in Python. Good understanding of SQL
• Has DevOps tooling user skillset in using Jira/Confluence, GIT and a CICD tool
• Familiar with Cloud Platform and its tools and services (e.g. S3, EC2, EMR, Spark, DynamoDB, Athena)
• Working knowledge of Hive, Spark SQL, DataFrames and GraphFrames
• Working knowledge ETL Process in Data Warehouse
• Working knowledge of Framework for Data Collection and Analysis
• Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
• Experience working on AWS
• Experience working web crawling and developing api
• Machine Learning API such as Keras, Tensorflow, SK-learn

Apply now : https://bit.ly/3FnZ3tf