компания "softswiss" responsibilities: apply diverse data technologies such as spark, kafka, clickhouse, and other similar tools from big data technology landscape to build business-critical, scalable and robust data pipelines and intuitive data products that power data discovery & analysis in a self-service manner; design an extensible, highly scalable and optimized real-time data analytics platform; own the data products critical for product innovation and recommendation engines; continually acquire new data sources to develop an increasingly rich dataset that characterizes users, content, and marketing; be comfortable outside of your comfort zone - explore new tech, make your own tool, or find a new way to address an old problem. requirements: senior experience in software engineering, deployment, and integration with data delivery systems and other components, building microservices, providing apis for models access; proficiency in at least one high-level programming language (scala, java, python or equivalent); experience in data environments, such as data lakes, data warehouses, data marts, data transformation concepts and working with large data volumes; experience in building etl pipelines to perform feature engineering on the large-scale datasets using apache airflow experience with sourcing and modeling data from application apis. experience with building stream-processing applications using spark-streaming, kafka streams or others. would be a plus: experience with low-latency nosql datastores (such as hbase, cassandra, mongodb), relational databases (such as mysql, postgres) and search systems (such as elasticsearch, solr) is a plus; • experience with running machine learning models in production is a plus; devops tools (e.g. ansible, docker, kubernetes); masters, ph.d or equivalent experience in software engineering, mathematics or computer science. work conditions: possibility to work in the co-working office space or remotely (outside the country as well) relocate options with company support top hardware and additional equipment provided free english lessons 4 paid sick days, 1 day off and 20 workdays vacation referral program paid training programs, certifications, conferences including international events corporate celebrations, team buildings, and fun activities
Адрес
Грузия Тбилиси