Our client provides data collection services. The service they have developed collects, analyzes, and provides data on sales, shares, traffic, and conversions, and determines the market share. This allows their clients to optimize strategic decisions in the retail field.
Our task is to optimize the speed of the web scraping applications.
Core technologies used: Java, Spring, Amazon AWS (EMR, Hbase, Redshift, S3, Lambda, Hive), Kafka, PostgreSQL, microservice architecture, and web-scraping solutions.
Required Skills and Experience