Big Data Software Engineer

Our client is a New York City-based FinTech company that is building a software platform for the investment banking industry and a line of products to serve the needs of financial companies.

The Big Data specialist will work on building a system for creating complex queries into a structured data warehouse system for the operations of quantum traders.

The specialist we are looking for will join the distributed team of 30-people working from Ukraine, Russia, Poland, and the USA. The whole DataArt team consists of several streams dedicated to different projects. Each project team is under the leadership of a technical lead.

Responsibilities

• Developing a cloud data analytics platform using AWS and Apache Spark (Databricks)
• Developing Apache Spark applications aimed at processing financial data

Must have

• Basic theoretical knowledge of Big Data and related technologies: RDBMS, NoSQL, Consistency (ACID, BASE), OLAP and OLTP, massive parallel processing, data warehousing
• Intermediate level in Python
• Intermediate level in data platforms (RDBMS). Understanding of relational models and basic database concepts and components. Proven experience with at least one relational database
• Novice level in Big Data Platforms (Apache Spark)

Would be a plus

• Scala programming language
• Experience with AWS (S3, EMR, Athena)
• Experience with Databricks

DataArt offers:

• Professional Development:
  - Experienced colleagues who are ready to share knowledge;
  - The ability to switch projects, technology stacks, try yourself in different roles;
  - More than 150 workplaces for advanced training;
  - Study and practice of English: courses and communication with colleagues and clients from different countries;
  - Support of speakers who make presentations at conferences and meetings of technology communities.
• The ability to focus on your work: a lack of bureaucracy and micromanagement, and convenient corporate services;
• Friendly atmosphere, concern for the comfort of specialists;
• Flexible schedule (there are core mandatory hours), the ability to work remotely upon agreement with colleagues;
• The ability to work in any of our development centers.