Big Data Senior Engineer #7224

Purpose of the job:

As Senior BigData engineer you will be a part of co-located feature team which will be responsible for real-time processing of massive data, and further real-time project monitoring.

MAIN TASKS AND RESPONSIBILITIES:

• Design and development of the next generation of our data platform including data streaming, batch and replay capabilities
• Design and development of application developer APIs to interact with the data platform
• Design, build and launch new data models and ETL pipelines
• Be part of co-located feature team which will be responsible for real-time processing of massive data, and further project of real-time monitoring and Threshold Detection System creation/enhancement.
• Participate in architectural design of content that is developed for new releases of the product
• Research and evaluate technical options to implement business requirements
• Analyze and optimize solution to fit performance SLAs
• Ensure high quality development standards (unit/integration tests, etc.)
• Become the technical owner of several areas of the product, being responsible for area support and improvement
• Collaborate with other R&D, QA, PM both on Lohika and customer side
• Proactively raise technical risks and suggest solution to minimize them
• Suggest technical and functional improvements to add value to the product

EDUCATION, SKILLS AND EXPERIENCE:

MUST HAVE:

• 5+ years of commercial Java development experience
• 1+ years of commercial Big Data experience
• Can work with cross-team members on large and complex projects
• Can breakdown a complex situation and come up with an elegant solution
• Experience in real time data processing development
• Proficient in designing efficient and robust ETL workflows
• Extensive hands on experience with AWS and cloud-based computing such as EC2, EMR, Kinesis and Redshift
• Strong experience with Kafka
• Strong experience with Spark (Core, SQL)
• Deep knowledge of Java Core, Java EE
• Experience in API development
• OOP, OO Design Patterns
• Good English (verbal & written) and communication skills in general

WOULD BE A PLUS:

• Redshift commercial experience
• Experience with Apache Airflow
• Performance testing framework creation for BigData solutions
• Experience with AWS or other cloud platforms.
• Machine Learning experience
• Python knowledge
• Computer Science diploma