Lead Data Engineer

• Architectural design, development and support of infrastructure for big data storage and processing based on ClickHouse and Kafka;
• Development, testing and optimization of ETL data processing and analysis processes (currently in Python and Logstash);
• Tracking data quality and resolving related issues in a timely manner;
• Testing and implementation of new Business Intelligence products;
• Developing machine learning solutions based on data from the warehouse;
• Assisting and advising developers, analysts and data scientists;
• Maintaining documentation on the solutions being developed and implemented;
• Development of internal and public APIs for interaction between services;
• Formation of a team capable of prompt and effective solution of assigned tasks;
• Interaction with related departments, customers;
• Implementation and support of quality development practices (code reviews, testing, mentoring, knowledge sharing, etc.).

• Excellent knowledge and experience with large data storage and processing systems;
• Practical experience with relational and non-relational databases;
• 5+ years of experience in Python3;
• Excellent knowledge of Python in loaded applications: threads, processes, asynchrony. Good knowledge of asyncio;
• Understanding of the principles of building scalable systems, main problems, solutions;
• Ability to work with the Git version control system;
• Ability to understand other people's code and document your own;
• Experience in code reviews, understanding of the principles of good code;
• Understanding how the deployment of services works: what happens in Gitlab CI/CD, Ansible, Docker.
• Experience with agile methodologies (scrum, kanban).

Will be a plus:

• Experience in Linux system administration;
• Knowledge of cloud platforms (AWS, Google Cloud, Azure);
• Experience with Kubernetes, Helm charts.

• Work in the international company;
• Official employment and even more - additional days off, extra payment for a sick leave as well as employee assistance programs;
• Hybrid working format (office/home office)
• Company laptops for convenient work from home;
• Modern office with a play area;
• We always have fresh fruit, vegetables and beverages;
• We are “for” healthy lifestyle and encourage our employees to do sports;
• Corporate education - courses and trainings, meetups and conferences;  
• A discount for learning English for the employees; 
• Voluntary health insurance after probation period; 
• Buddy Program and English Speaking Club for efficient onboarding, communication and meetings with colleagues;
• Unforgettable corporate parties and team building for teams.