Middle/Senior Data Engineer (AdTech Platform Development)

Are you passionate about collecting, storing, and analyzing big data? Are you constantly looking for ways to work smarter, delivering new efficiencies anywhere an improvement can be made? Are you able to explain the most technical data to the least technical people without any confusion? If yes, you are very likely the one to enjoy this role!

CUSTOMER

Our customer is a US-based technology company that builds the next generation of advertising products and premium video experiences.

The company pioneered the engagement-based ad model and now delivers effective advertising for on-demand, interactive media. Having a solid belief that ads should be enabling rather than interruptive, it has built the definitive engagement advertising system around the core product. The latter one delivers on the promise of «zero waste» advertising. Thus, our customer provides the best advertising experience for consumers, the best monetization for premium publishers, and the best return for brand advertisers.

PROJECT

As a Data Engineer, you will be an important part of the team that owns our data infrastructure. This is no small responsibility, as an AdTech company, data is a lifeblood, and there is a lot of it. Suppose you are excited by and have experience in ingesting, processing, storing, analyzing, and working in a Big Data environment. In that case, you are very likely the one to enjoy this role too!7

RESPONSIBILITIES

• Build and modify Spark jobs in Scala to perform various tasks, from reading Kinesis streams using Spark Streaming, to joining and aggregating huge data sets, to integrating with third-party data sources
• Develop and launch new features to adapt to evolving business needs
• Be an active and engaged owner of data infrastructure
• Be curious and seek to understand all aspects of our business
• Maintain high standards of code quality and encourage the same by providing constructive code reviews to collaborators
• Troubleshoot and resolve issues, problems, and errors encountered across various systems
• Gather requirements when underspecified

REQUIREMENTS

• BS in Computer Science or related field
• Strong knowledge of SQL
• Strong knowledge of Spark using Scala
• Experience debugging and optimizing Spark jobs
• Working knowledge of serialization formats and their trade-offs columnar vs. row-based
• Familiarity with database fundamentals, such as ACID, Snowflake schema, normalized/denormalized data
• Upper-Intermediate level of English

WOULD BE A PLUS:

• Familiarity with the columnar database, key-value stores, document stores, stream processing, time-series databases, data warehouses, and OLAP
• Experience working with HDFS and S3
• Familiarity with Data Science tooling in Spark
• Experience in the advertising industry is a plus
• Experience with real-time analytics