Hadoop engineer for DataOps team (Georgia/Spain)

компания "dins" the dataops team is responsible for the building-out, configuration, and support of analytics platforms to provide other teams the possibility to work on data from different sources in one place. the core of those platforms is the hadoop platform (cloudera distribution) whose current capacity is almost reached 5 pb and continues to grow. besides hadoop, the dataops team supports a huge variety of 3rd party platforms and services including but not limited to datarobot, tableau, kafka, snowflake, and vertica. now we are seeking an engineer who is passionate about the it area, building and supporting an infrastructure to provide the highest level of service on which other teams may rely on. from our side, we always encourage professional growth and ambitions to study and implement new technology stacks. what you will do: support and improve big data platforms hadoop, spark cluster, vertica db, snowflake saas, etc.; develop new solutions for automation based on python, go, ansible, and jenkins; maintain and extend an infrastructure for big data processing based on on-premise and cloud solutions (aws); provide technical support for other teams (developers, system analysts, data scientists, data analysts, etc.), perform troubleshooting, and find solutions for challenging problems; work on disaster recovery scenarios and increase the robustness of the supported platforms; build test environments for developers and qa teams to ensure high-quality delivered applications. you will be able to work with: the big data technology stack – hadoop, apache spark, snowflake saas, etc.; message broker – apache kafka; modern technologies like virtualization based on docker and vmware, deployment system – ansible; ci/cd – jenkins, gitlab, sonatype nexus; databases: vertica, mysql, postgresql, mongodb. experience and skills: bachelorchr(39)s degree in computer science, computer engineering, information systems, mis or related field and equivalent practical experience; 3+ years of experience in production back-end platform support as a system administrator; hands-on experience with a hadoop platform; hands-on experience with writing scripts on python, bash, or go; hands-on experience with jenkins and git; linux os system administrator level; knowledge of ipv4/ipv6, tcp/udp, dns, http, ssh; personal traits: independent, responsible, and attentive; english level – intermediate or above. would be a plus: hands-on experience of working with different kinds of monitoring systems like zabbix, prometheus, or tick; hands-on experience with snowflake saas; hands-on experience with mongodb, and vertica; hands-on experience with java/scala applications and maven tool; hands-on experience with the support of 24x7 systems. conditions: work for foreign company (georgia), further relocation to spain; relocation bonus; well-coordinated professional team; cutting edge technologies, interesting and challenging tasks, dynamic project, great opportunities for self-realization, professional and career growth; job placement and payment of salary take place according to the labor code, as well as vacation and sick lists; corporate training programs, english language courses.