Data Platform Engineer

We’re hiring a senior backend engineer to work in our data platform. Our data platform is the core of our product, and the data we process, curate, and enrich is what allows our customers to identify audiences, extract insights and inform their decisions.

We handle over one thousand million social profiles, enrich, classify and enhance them with the information that allows our customers to define their marketing campaigns, identify influencers and discover new market niches.

You’ll be working in a fully remote, cross-functional team. Ideally, you’ll have experience working with data platform concepts such as datalakes, streaming pipelines (Kafka), ETLs, etc, but if you are a motivated quick learner with experience in even only a few of these concepts you’ll pick things up. We currently write code in Python, Typescript and Scala, however we try not to be locked into one particular technology. We want to find individuals with potential, an interest to grow with us and help us improve.

As the data platform is the core of our product, we are dedicating a lot of effort and research to improving and developing it. Here are some example projects you may work on:

• Implementing Kafka consumers and producers as part of our recently deployed streaming oriented data pipeline (we have just migrated from batch oriented pipelines to a more real time oriented model with Red Panda at its core).
• Designing and deploying new enrichment processes to expand our social profiles, from machine learning processes that infer age range to interest identification algorithms (there’s a lot of space for innovation here, and we are constantly looking for new technologies to apply).
• Creating Airflow DAGs to automate processes and make our lives easier when managing our Datalake.
  
• Writing and running Spark jobs to extract insights from our datalake that help us answer our customers’ questions.
  
• Finding ways to optimise our query engine, enabling our customers to find better, more specific audiences.