Data Engineer / Senior Spark Developer (IRC89675)

GlobalLogic Ukraine is inviting a Data Engineer / Senior Spark Developer to join its Kyiv office.

You will have the opportunity to lead and deliver spark development in some of the most complex Data Science and AI projects in the Oil and Gas Industry, ranging from the Data Engineering challenges of big data to the distributed computational Machine/Deep learning demands of Data Science and AI.

We offer:

• Interesting and challenging opportunity in a large and dynamically developing company
• Exciting projects involving newest technologies
• Professional development opportunities
• Excellent compensation and benefits package, performance bonus program
• Modern and comfortable office facilities

Requirements

•  5+ years of hands on experience with Apache Spark(Pyspark/SparkR/sparklyr)
•  Experience using Spark in the Databricks Ecosystem
•  Deep knowledge in the design and implementation of Distributed File Systems, Data Warehousing and Streaming technologies, including data architecture patterns, using Azure
•  Experience in deploying and managing Spark ML models at scale
•  Excellent communication and presentation skills
•  Passionate about learning and experimenting with new technologies

Responsibilities

•  Provide expertise and guidance in the architectural design and implementation of Spark projects, from Data Engineering using Cloud Storage to Machine Learning/Deep Learning pipelines in Data Science and AI
•  Implementation and delivery of globally scalable and supportable Spark workloads to a production grade level of quality in an Agile Devops working environment
•  Engage and consult with end users to understand real world problems worth solving and relating how distributed cloud computing can solve them
•  Provide technical leadership and impart Spark knowledge to project team members and others in the Data Science Community