Senior AWS Data Engineer (IRC96429)

GlobalLogic Ukraine is inviting a Senior AWS Data Engineer to join its Kyiv office.

We develop a supplier collaboration platform for orchestrating of construction's heavy work for US-based partner.

This cloud-based platform built on AWS using Javascript and Node.JS, React frameworks. Its purpose is increasing collaboration between contractors and project owners, and their heavy material suppliers, producers and haulers. It facilitates every step in the workflow from initial orders through to paying the final bill.

In addition to this platform has advanced mechanisms for revealing insights collected from a variety of sources, including IoT devices, telematics, Jobsite tech, production automatics, etc. Collected analytics help making better business decisions, operate more efficiently and see actionable info in real time.

Users interact with the platform using the web, and mobile applications running Apple iOS and Android devices.

Requirements

• AWS data ingestion frameworks, such as Kinesis, DMS (in use)
• AWS data processing (CDC,ETL) frameworks, such as EMR (in use), AWS Glue/Athena (in use), Sqoop, Spark, Zeppelin, Kinesis tools
• AWS pipeline orchestration technologies, such as Data Pipeline(in use), Step Functions, and Lambda (in use)
• AWS data storage engines, such as S3 (in use), HDFS (in use), Dynamo (in use)
• AWS data access/warehousing tools, such as Athena (in use) and Redshift
• Understanding the strengths and weaknesses of each tool/service and what it's best used for
• Should be comfortable in Linux and using command line
• Proficiency in software development in Python (in use), Scala, Javascript (node in use), or Java
• Deep familiarity with SQL (heavily used)
• Good understanding of distributed systems in general and how they are different from traditional storage and processing systems
• Passionate about "Big Data" and wants to expand their skills in the realm of data science infrastructure and tooling
• Experience with data visualization tools like Tableau (in use) or ElasticSearch will be a big plus

Preferences

Big Data

Responsibilities

• As our corporate data strategy evolves from business analytics to data science, there will be numerous opportunities to utilize new technology and learn new skills.
• As a key player of a dedicated team, you will be instrumental in driving the direction of the pipeline infrastructure from ingestion through to access.
• We are seeking a motivated senior data engineer to architect, build and support AWS data pipelines for our corporate data strategies.

• Architect, build and maintain data pipelines as a key player of the company long term data strategies

• Utilizing AWS services, build and support reliable multi-tenant data pipelines combining data multiple diverse data sources

• Providing scalable tools and mechanism for data ingestion, cleansing and ETL

• Make pragmatic iterations of pipelines as the companies needs grow over time

• Providing and support infrastructure for pipelines, data access, and visualization

We offer:

• Interesting and challenging work in a large and dynamically developing company

• Exciting projects involving the newest technologies

• Professional development opportunities

• Excellent compensation and benefits package, performance bonus program

• Modern and comfortable office facilities