Lead Data Engineer

Development and testing
Moscow, Russia, Minsk, Belarus

Admitad is not a monolithic company; it operates several businesses as well as launching or buying new ones. These businesses do not store meaningful product and financial data uniformly, but in raw form and in some cases not for long. The task is to collect, aggregate and give the company's analysts the data and provide tools to create regular and adhoc reports required to support management decisions. Technically, it's an in-house data warehouse. The ingredients are ClickHouse as storage and kafka+logstash as transport and processing.

  • What you'll do:
    • Architectural design, development and support of infrastructure for big data storage and processing based on ClickHouse and Kafka;
    • Development, testing and optimization of ETL data processing and analysis processes (currently in Python and Logstash);
    • Tracking data quality and resolving related issues in a timely manner;
    • Testing and implementation of new Business Intelligence products;
    • Developing machine learning solutions based on data from the warehouse;
    • Assisting and advising developers, analysts and data scientists;
    • Maintaining documentation on the solutions being developed and implemented;
    • Development of internal and public APIs for interaction between services;
    • Formation of a team capable of prompt and effective solution of assigned tasks;
    • Interaction with related departments, customers;
    • Implementation and support of quality development practices (code reviews, testing, mentoring, knowledge sharing, etc.).
  • What we expect:
    • Excellent knowledge and experience with large data storage and processing systems;
    • Practical experience with relational and non-relational databases;
    • 5+ years of experience in Python3;
    • Excellent knowledge of Python in loaded applications: threads, processes, asynchrony. Good knowledge of asyncio;
    • Understanding of the principles of building scalable systems, main problems, solutions;
    • Ability to work with the Git version control system;
    • Ability to understand other people's code and document your own;
    • Experience in code reviews, understanding of the principles of good code;
    • Understanding how the deployment of services works: what happens in Gitlab CI/CD, Ansible, Docker.
    • Experience with agile methodologies (scrum, kanban).

    Will be a plus:

    • Experience in Linux system administration;
    • Knowledge of cloud platforms (AWS, Google Cloud, Azure);
    • Experience with Kubernetes, Helm charts.
  • We offer:
    • Work in the international company;
    • Official employment and even more - additional days off, extra payment for a sick leave as well as employee assistance programs;
    • Hybrid working format (office/home office)
    • Company laptops for convenient work from home;
    • Modern office with a play area;
    • We always have fresh fruit, vegetables and beverages;
    • We are “for” healthy lifestyle and encourage our employees to do sports;
    • Corporate education - courses and trainings, meetups and conferences;  
    • A discount for learning English for the employees; 
    • Voluntary health insurance after probation period; 
    • Buddy Program and English Speaking Club for efficient onboarding, communication and meetings with colleagues;
    • Unforgettable corporate parties and team building for teams.

Apply for vacancy:

Thank you for your message. It has been sent successfully.