Data Engineer

London, UK
Badoo – Business Intelligence
Full-time
Badoo is looking for an exceptional Data Engineer to join our quirky data team. We’re solving interesting problems using cutting-edge tools - working on an in-house analytics platform which captures tens of billions of events a day from more than a hundred various data sources; then aggregates, processes and stores them in Hadoop and Exasol using Spark and Presto. Data is then consumed from reports and visualisations on our React based portal using D3.

KEY ACCOUNTABILITIES

    • Contribute to all parts of our data platform (from metadata definition framework through data pipelines to the visualisation interface)
    • Write unit tests and perform code reviews
    • Explore and experiment with new tools, libraries and technologies to improve and simplify our solution
    • Take ownership of certain parts of the project
    • Maintain a vision of the product and its place within the company; create prototypes to showcase the vision
    • Support existing users of the platform, explain new features to them and help new joiners to get started

REQUIRED SKILLS AND KNOWLEDGE

    • Ability to understand business requirements and goals
    • Ability to write easily understandable and maintainable code in many languages
    • Interest in data analysis and visualisation
    • Primary programming skill is Python as a language of most of the data pipeline processing code
    • Java (Hadoop/Spark) as a secondary language
    • Understanding of various SQL and NoSQL systems (Redis, CouchDB, Postgres, MySQL, Redshift etc), their strengths and weaknesses
    • Good level of Unix skills and bash scripting

DESIRABLE

    • Most of Badoo itself is written in PHP so some familiarity with the language would definitely be useful
    • Client-side development with Javascript (React/Flow)
    • Demonstrable experience in projects related to data and metadata
    • Side projects or open source contributions
    • Polyglot experience in general