Senior Systems Engineer

Today we are a global team of technologists and thinkers, who help transform the world with the power of software, enabling our customers to be competitive and disruptive in the marketplace through innovative technology solutions.

DESCRIPTION

The ideal candidate has a solid background in system administration and is able to work as a part of the DevOps team running an analytical ecosystem in modern cloud-based data systems in a fast-paced, agile environment.

 The specific focus is on processing engine development as well as the design, development, automation, and optimization of its usage in the client’s analytic ecosystem. 

RESPONSIBILITIES

• Participate in a continuous delivery pipeline to fully automate deployment of the highly available cloud platform that supports multiple teams/projects
• Build tools for deployment, monitoring and operations. Troubleshoot and resolve issues in our development, test, and production environments
• Work with platform architects on software and system optimizations, helping to identify and remove potential performance bottlenecks
• Stay up-to-date on relevant technologies, understand trends and opportunities to ensure we are using the best possible techniques and tools
• Understand, implement, and automate security controls, governance processes, and compliance validation
• Design, manage and maintain tools to automate operational processes

 REQUIREMENTS 

• Expertise in major Data technologies and frameworks including but not limited to Hadoop, Hive, HBase, Spark, Kafka, Flume, ZooKeeper, Parquet, Avro, etc.
• Background knowledge of at least one RDBMS or NoSQL engines: PostgreSQL, MySQL, Cassandra, Elasticsearch, Redis, MongoDB, Impala, Kudu, etc.
• Hadoop administration experience, including clusters troubleshooting, migration, and consolidation
• Experience of working with Data solutions developed in large cloud computing infrastructures such as Amazon Web Services (EMR, RedShift, Kinesis, Athena, Glue, Lambda), Azure (Databricks, Data Factory, Data Lake, Azure Batch, Azure Function, HDInsight), or Google Cloud Platform (Cloud Dataproc, Cloud Dataflow, Google Cloud Dataprep, Cloud BigTable, Cloud PubSub, Cloud Composer)
• Practical experience of Java, Scala, or Python code lifecycle in Data pipelines
• Strong background in Linux administration and scripting (Bash)
• Strong understanding of Continuous Integration and Continuous Delivery principles and experience building CI/CD processes with one of Gitlab, Travis, Jenkins, or Octopus
• Familiarity with software process automation with popular scripting languages (e.g. Python, Ruby)
• Good understanding of version control systems (Git)
• Excellent communication skills
• Upper-Intermediate level of written English (B2+)

NICE TO HAVE 

• Experience of working with containerization platforms such as Docker, Kubernetes/Openshift
• Cloudera CDH 5.1 or higher: installation, set-up, on-prem deployment, cluster balancing and performance optimization, workload monitoring & proactive alerting
• Experience of usage of infrastructure as code and desired state management tools (e.g. Ansible, Chef, SaltStack, Terraform)

BENEFITS

• Competitive compensation depending on experience and skills
• Individual career path
• Social package - medical insurance, sports
• Unlimited access to LinkedIn learning solutions
• Sick leave and regular vacation
• Partial coverage of costs for certification and IT conferences
• English classes with certified English teachers
• Flexible work hours

EVEN MORE EPAM BENEFITS 

• We offer the possibility to work on full product lifecycle -from concept to delivery into production
• We offer mentorship program
• We offer guaranteed professional growth through the technology trainings and technology communities inside EPAM
• We are proactive Agile/Scrum/XP practitioners