Senior BigData Engineer, Financial Software Solutions

DataArt is engaged in software development and IT consulting. More than 3000 of our specialists work in 22 development and sales centers around the world. At the same time, we remain a highly integrated team. At the heart of DataArt's corporate culture is the value of diversity and trusting and respectful relationships.

Our client is a New York City-based FinTech startup that is building a trading and risk software platform for the investment banking industry to sell as a service.

DataArt has become the client's main technology partner. The project is currently in development and we plan to increase DataArt's team during the year. The processes in the project are built based on Agile.

The BigData specialist will work on building a system for creating complex queries into a structured data warehouse system for the operations of quantum traders.

Core technologies: Python, Java, AWS, JavaScript, Cloud Architecture, React Native, Apache AirFlow, Hadoop, Drill.

Required Skills and Experience

• Strong knowledge of Big Data general concepts
• Strong Knowledge of Java, Scala or Python
• Strong Knowledge of Hadoop Ecosystem (HDFS, Map-Reduce, Yarn, Hive)
• Strong Knowledge of NoSQL DB (any popular)
• Strong Knowledge of Spark (Core, SQL, Streaming)
• Strong Knowledge of Kafka
• Experience with AWS
• Spoken English

Additional Competencies

• Knowledge of Hortonworks Data Platform (or Cloudera)
• Experience with Public Clouds (Azure, Google, etc.)
• DevOps skills
• Experience troubleshooting production systems

DataArt offers:

• Professional Development: 
  - Experienced colleagues who are ready to share knowledge; 
  - The ability to switch projects, technology stacks, try yourself in different roles; 
  - Study and practice of English: courses and communication with colleagues from different countries; 
  - Support of speakers who make presentations at conferences and meetings of technology communities.
• The ability to focus on your work: a lack of bureaucracy and micromanagement, and convenient corporate services;
• Friendly atmosphere, concern for the comfort of specialists;
• Flexible schedule.