Senior Data Engineer

About Client:  

Our client has the world's largest travel site, enabling travelers to plan and book the perfect trip. The site offers trusted advice and rich content from real travelers and checks hundreds of websites to find the best hotel prices. Client's branded sites make up the largest travel community in the world, reaching 450 million unique monthly visitors and more than 600 million reviews and opinions covering 7 million accommodations, restaurants, airlines, and experiences.

About Project:

The SoftServe Team is part of Client's distributed team helping to build a new first-in-class B2B experience that connects hoteliers with travelers around the world. New product offerings and intelligent ad campaigns with assisted targeting and dynamic price models allow hoteliers to showcase their properties and optimize ad spend. We are rapidly transitioning to web components and React powered by microservices and PostgreSQL and hosted on Kubernetes on the backend. Our development cycles are short and iterative. We provide a collaborative environment that emphasizes continuous learning, project ownership, and "speed wins".

Job Purpose: 

We are looking for a Senior Data Engineer to own the B2B data pipeline design, implementation, monitoring and alerting. You will work in a collaborative environment with product managers, database and full-stack engineers, and analytics and measurement specialists to build functional products and applications. Senior Data Engineer responsibilities include live site tracking and logging, database and schema definition, ETL, data quality and anomaly detection, data aggregation for complex business reporting and supporting data science modeling. We work in PostgreSQL, Hadoop, Redshift, Spark, Snowflake, Hedwig, and other Big Data tools. If you have hands-on experience in data engineering and enjoy working at scale with cutting-edge technologies, we'd like to meet you.

Responsibilities:

• Design scalable live site tracking and logging for B2B products
• Define databases and schema in a microservices environment
• Build ETL pipelines to support business analytics, live site data retrieval, and data science modeling
• Build monitoring and alerting for anomaly detection
• Assure data quality through automated testing
• Write complex optimized queries
• Perform backfill operations
• Participate in design reviews, code reviews, team meetings, and QA
• Document databases, schema, and ETL pipelines
• Collaborate and build a trusted relationship with Client

Requirements:

• Solid database architecture and schema design skills
• Highly proficient writing complex SQL queries
• Experience using PostgreSQL, Hadoop, and other Big Data tools
• Experience implementing website tracking and ETL pipelines
• Ability to transform raw, noisy log level data into useful business fact tables
• Experience building data workflows and platforms, familiarity with leading libraries
• Computer Science expertise - algorithms, data structures, software engineering
• Fluent in Java, Python
• Strong analytical, verbal, and written communication skills
• Collaborative and problem-solving mindset
• Degree in Computer Science, Engineering or relevant field