Senior Data Engineer #7098

Purpose of the job:

Our customer takes the leading position in advanced data analytics and engineering expertise. Therefore, it is a huge infrastructure with a lot of niches for engineering and development. As a part of the team, a candidate's mission is an investigation of the existing analytic platform, based on Python, Apache Spark and AWS Cloud services, as well as update and support it in a long-term perspective.

MAIN TASKS AND RESPONSIBILITIES:

• Take part in requirements analyzes
• Identify and encourage areas for growth and improvement within the team
• Interact with customer and provide technical solutions
• Work with engineering, data science and product management teams to build and manage a wide variety of data sets
• Identify gaps and build the tools to increase the speed of analysis
• Implement new features
• Update and support an existing functionality
• Conduct code reviews
• Drive features from conception to deployment in an agile team with continual delivery
• Provide support to QA and other teams
• Be technical mentor for less experienced team members

EDUCATION, SKILLS AND EXPERIENCE:

MUST HAVE:

• 5+ years of experience in developing software at scale
• 3+ years of Python commercial development experience
• Mathematical and statics skills
• Experience with Apache Spark (pyspark)
• Strong experience with Pandas library
• Strong experience with scientific tools (numpy, scipy)
• Strong experience with relational database
• Experience with data visualization
• Unit testing experience
• Think at scale, and with high availability
• Can work with cross-team members on large and complex projects
• Can breakdown a complex situation and come up with an elegant solution
• Sufficient English level for communication (verbal & written)
• Fast research and learning skills

WOULD BE A PLUS:

• Technical University degree
• Knowledge of ML algorithms
• Experience with AWS services like EC2, S3, EMR, etc.
• Experience with Mesos or Kubernetes.
• Experience with Docker.
• Experience with R