Senior Data Engineer (Ref 22674)


Salary: £75,000 to £80,000 p.a. + 10% Bonus

Location:  London

Global analytics company requires Senior Data Engineer with experience in big data and technologies such as Spark, Scala and the Hadoop ecosystem to work on the company’s Data Platform. You will be joining the Agile team in the London office to help design and build the Data Platform as well as integrate with other systems.

The Data Platform harvests data from the company’s numerous data streams, identifying researchers and artifacts in disparate systems, and linking them together into coherent entities. The consolidated data we produce enables our knowledge graph and recommendation systems to derive higher-level insights and deliver value to the research community.

The component we are building is aiming to deduplicate articles in Realtime and provide unique views to various downstream components.

You will work closely with in house data scientists, product team, architecture and the other software engineers on building streaming data solutions. You will be enthusiastic about engineering quality and be interested in sharing good practices within the team and the company as a whole.

Main Duties:

  • Developing Big Data applications that exploit a unique and large collection of scientific data
  • Contribute to defining the project tech stack and standards in the team & department
  • Building well-formed APIs and services to allow members of the wider company ecosystem to easily integrate with our applications
  • Taking advantage of techniques such as pair programming and continuous delivery

Skills Required

  • Development experience on the JVM using Scala / Java
  • Familiarity with Big Data Technologies such a Spark, Hadoop
  • Familiarity with Kafka
  • Familiarity with AWS and/or Cloudera
  • Agile experience with Scrum/Kanban/XP
  • Experience with agile engineering practices such as TDD, pair programming, continuous Integration, automated testing and deployment

Salary: £75,000 to £80,000 p.a. + bonus

Location: London

Apply Now