Skip to main content

Lead Data Engineer

WorldRemit, London
Employment type: 
Full time
Agile, Design, Software, Software Engineering, SQL, Python, Analytics

Similar jobs

No similar jobs found.

Materials Hack
Playground for innovative materials powered by Borealis.
8th-10th July – Vienna, Austria
Learn more
2.5
days Hackathon
3
weeks Incubation
2
winning teams
24K
cash prizes

Lead Data Engineer

LEAD DATA ENGINEER

 

The role:

Based in London and working in our Data Engineering team, you’ll be helping us develop our data streaming and analytics capabilities. We have users sending money from 50 countries to over 150 countries – and we’re expanding. The work is varied, from creating new products and features to improve existing functionality, we strive to build a better customer experience and a better codebase. This is real growth at pace.

This is a lead position where you will be using all of your experience and knowledge to help the team build out a robust data streaming platform that supports the near real time insights for analytics and machine learning applications. You’ll be using multiple services from the AWS stack, Python, Kafka and Spark to achieve this.

 

What we are looking for:

 

  • A data streaming expert. You have built out data streaming platforms using technologies like Kafka, implementing robust architectures that scale effectively and deliver near-real-time insights.
  • A skilled Python Data Engineer. You are experienced in building complex ETL pipelines using Python.
  • Solid SQL experience. You can not only interact with a database using SQL but design new schemata.
  • Experience of the AWS stack. You have some previous experience of working with the AWS toolset.
  • Big-data experience. You have used big data related tools and techniques extensively in previous roles (data lakes, distributed processing platforms, streaming technologies).

 

  • Exposure to Machine Learning. You understand the basics of machine learning, primarily in the area of feature engineering and supporting ML pipelines
  • Happy in the Clouds. Our Cloud Native platform is hosted on AWS and Azure. You’ll be comfortable working with a system that supports users from around the world, at scale.
  • Well-principled. Especially in the craft of Software Engineering – you will understand deeply: modularity, testability, extensibility, scalability and other –ilities.
  • Bias for action. You see a problem, you fix a problem. You get buy in for your solutions and keep tickets moving. We’re always looking for ways to ship at pace. 
  • Growth mindset. A willingness to use your skills and experience to mentor less-experienced engineers. A desire to learn from others and make yourself better every day.
  • Agile outlook. You need to be excited about working in a fast-changing environment. Products, tools, frameworks and processes change, we evolve and take the best bits with us. The teams drive the evolution.


Your responsibilities:

Top