Big Data engineer

компания "skipp.pro" skipp is an international startup that helps build remote development teams behind the staff and manage them using the interfaces of our own platform. at the moment we have more than 70 active customers and 300 executors, including programmers, designers, analysts, architecture specialists, managers, and know-how specialists. we have a strong team of like-minded people and mentors who have built and developed large russian and foreign companies such as lingualeo, skyeng, mail.ru, delivery club, wheely. at the end of 2021, we have grown more than tenfold, entered the top 5 perspective startups according to russian inc, but most importantly, our team has more than tripled in size and now have more than 50 internal employees from 7 countries with offices in cyprus and london. in 2022 we plan to grow by more than 3 times, expand the geography of employees and countries of presence, and of course build a strong corporate culture, recognizable employer brand and transparent and efficient processes. project / company description: investment finance it incubator is an it startup that is the leader in attracting business investment. the team helps companies generate ideas for it products, attract the right people, and invest in their development. at ithis company, small and mid-sized businesses achieve their financial goals much more easily through investment and incubation programs. this company is a guarantor of stable investments in your business. in their international team, the guys want a cool and professional big data engineer who will be the backbone of the data team and will be responsible for developing and monitoring the data collection pipeline. tasks: creating or updating data pipeline features using gcp components such as data flow, bigquery, bigtable; development of new services, dashboard for real time data quality and development of monitoring process; participate in the design and implementation phases of new microservices and machine learning functions connected to the pipeline; explore and implement new data sources; pipeline monitoring requirements: strong knowledge of one of the following technologies: apache beam ou spark, et hadoop; strong knowledge of java, python and/or golang; at least 2 years of experience as a data processing engineer; knowledge of clickhouse; a good level of english (written and spoken); experience of working with a cloud platform nice to have: an understanding of cro and/or web analytics; you know what it means to work in a team and work with other teams; you can put yourself in the customerchr(39)s shoes to analyse their actual needs we are waiting for you in our team!