Job Expired

Senior Data Engineer (IGT1 Lanka: Sitecore) - IFS Colombo

Posted June 9, 2025 by IFS Sri Lanka

Closing Date : July 6, 2025

Senior Data Engineer (IGT1 Lanka: Sitecore) - IFS 

About the position:
We are looking for a Senior Data Engineer to join our Data Platform group. In this position, you will work in a small, dynamic team to build data infrastructure and manage the overall data pipeline. You will be responsible for expanding and optimizing data and data pipeline architecture, as well as optimizing dataflow and collection of data from cross functional teams.

 

Responsibilities:

  • Design, develop, and maintain a generic ingestion framework capable of processing various types of data (structured, semi-structured, unstructured) from customer sources.
  • Implement and optimize ETL (Extract, Transform, Load) pipelines to ensure data integrity, quality, and reliability as it flows into the centralized datastore like Elasticsearch.
  • Ensure the ingestion framework is scalable, secure, efficient and capable of handling large volumes of data in real-time or batch processes.
  • Continuously monitor and enhance the data ingestion process to improve performance, reduce latency, and handle new data sources and formats.
  • Develop automated testing and monitoring tools to ensure the framework operates smoothly and can quickly adapt to changes in data sources or requirements.
  • Provide documentation, support, and training to other team members and stakeholders on using the ingestion framework.
  • Implement large-scale near real-time streaming data processing pipelines.
  • Design, support and continuously enhance the project code base, continuous integration pipeline, etc.
  • Build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics.
  • Perform POCs and evaluate different technologies and continue to improve the overall architecture.

     

Qualifications:

  • Experience building and optimizing Big Data data pipelines, architectures and data sets.
  • Strong proficiency in Elasticsearch, its architecture and optimal querying of data.
  • Strong analytic skills related to working with unstructured datasets.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data systems.
  • One plus years of experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems.
  • Candidates must have 2-4 years of experience in a Data Engineer role with a Bachelors or Masters Degree in Computer Science or Information Systems or equivalent field. Candidate should have knowledge of using following technologies/tools:
    • Experience working on Big Data processing systems like Hadoop, Spark, Spark Streaming, or Flink Streaming.
    • Experience with SQL systems like Snowflake or Redshift
    • Direct, hands-on experience in two or more of these integration technologies; Java/Python, React, Golang, SQL, NoSQL (Mongo), Restful API.
    • Versed in Agile, APIs, Microservices, Containerization etc.
    • Experience with CI/CD pipeline running on GitHub, Jenkins, Docker, EKS.
    • Knowledge of at least one distributed datastores like MongoDb, DynamoDB, HBase.
    • Experience using batch scheduling frameworks like Airflow (preferred), Luigi, Azkaban etc is a plus.
    • Experience with AWS cloud services: EC2, S3, DynamoDB, Elasticsearch

 

Additional Information:

  • We believe that coming together as a community, in person, is important for innovation, connection and fostering a sense of belonging. 
  • Our roles have the right balance of remote and in-office working to enable flexibility for managing your life along with ensuring a real connection with your colleagues and the broader IFS community.

සෑලකිය යුතුයි : අපි ඔබව මෙම රැකියාව උපුටා ගත් පිටුවට හරවා යවන්නෙමු . අපි ඔබ වෙනුවෙන් ඔබේ CV , තොරතුරු අදාළ ආයතනය වෙත නොයවන බව කරුණාවෙන් සලකන්න

கவனமாக இருக்க வேண்டும் : இந்த வேலை மேற்கோள் காட்டப்பட்டுள்ள பக்கத்திற்கு உங்களை திருப்பி விடுவோம். உங்களுக்கான CV, தகவல்களை சம்பந்தப்பட்ட நிறுவனத்திற்கு நாங்கள் அனுப்ப மாட்டோம் என்பதை நினைவில் கொள்ளவும்

Disclaimer : By clicking the button below, you consent for CareerFirst and partners to use automated technology, including pre-recorded messages, cell phones and texts, and email to contact you at the number and email address provided. This includes if the number is currently on any Do Not Call Lists. This consent is not required to make a purchase. We are redirecting you to the employer's career page. Please note that we are not sending your CV to the employer on your behalf. Privacy Policy.

RELATED JOBS

Intern - Industrial Engineering - MAS Kreeda Balangoda

MAS Holdings

Rathnapura
Full Time

Closing Date: 2025-08-05

Company Logo
Intern - Bonding - MAS Active Katunayake

MAS Holdings

Colombo
Full Time

Closing Date: 2025-08-12

Company Logo
Intern - Maintenance - MAS Intimates Ratmalana

MAS Holdings

Colombo
Full Time

Closing Date: 2025-08-09

Company Logo
Intern - Planning - MAS Linea Clothing - Pallekele

MAS Holdings

Kandy
Full Time

Closing Date: 2025-08-08

Company Logo
Intern - Planning - MAS Slimtex Kuliyapitiya

MAS Holdings

Kurunegala
Full Time

Closing Date: 2025-08-07

Company Logo
Tech Lead AIML - Virtusa Colombo 09

Virtusa Pvt Ltd

Colombo
Full Time

Closing Date: 2025-08-27

Company Logo
Tech Lead Java - Virtusa Colombo 09

Virtusa Pvt Ltd

Colombo
Full Time

Closing Date: 2025-08-27

Company Logo
Senior Project Manager - IFS Colombo 09

IFS Sri Lanka

Colombo
Full Time

Closing Date: 2025-08-27

Company Logo
Undergraduate Trainee – Quality Assurance - IFS Colombo 09

IFS Sri Lanka

Colombo
Full Time

Closing Date: 2025-08-28

Company Logo
Financial Controller – Litro Gas Limited Colombo 02

Litro Gas Limited

Colombo
Full Time

Closing Date: 2025-08-10

Company Logo
Internal Audit Officer - Central Provincial Transport Service Authority Kandy

Central Provincial Transport Service Authority

Kandy
Full Time

Closing Date: 2025-08-10

Company Logo
Technical Officer - Central Provincial Transport Service Authority Kandy

Central Provincial Transport Service Authority

Kandy
Full Time

Closing Date: 2025-08-10

Company Logo
Procurement Specialist – Ministry of Fisheries, Aquatic and Ocean Resource Colombo 10

Ministry of Fisheries and Aquatic Resources

Colombo
Full Time

Closing Date: 2025-08-07

Company Logo
Manager, Investigative Reporting - HSBC Bank Colombo

HSBC Bank

Colombo
Full Time

Closing Date: 2025-08-20

Company Logo
Database Manager - Banking Industry - In Talent Asia Colombo

In Talent Asia

Colombo
Full Time

Closing Date: 2025-08-27

Company Logo
Senior Executive Quality Assurance - Cinnamon Hotels & Resorts Colombo

Cinnamon Hotels & Resorts

Colombo
Full Time

Closing Date: 2025-08-27

Company Logo
Enterprise Data Architect - Commercial Bank Colombo

Commercial Bank PLC

Colombo
Full Time

Closing Date: 2025-08-25

Company Logo
Database Manager - Commercial Bank Colombo

Commercial Bank PLC

Colombo
Full Time

Closing Date: 2025-08-25

Company Logo
Assistant Manager – Analytics & AI (Dialog Finance) - Dialog Axiata PLC

Dialog Axiata PLC

Colombo
Full Time

Closing Date: 2025-08-24

Company Logo
Undergraduate Trainee - Software Engineer - Technology - IFS Colombo 09

IFS Sri Lanka

Colombo
Full Time

Closing Date: 2025-08-24

Company Logo