Senior Big Data Engineer, Investment Management Solutions

компания "dataart" клиент our client is a us-based investment management business of an american fortune global 500 and fortune 500 company whose subsidiaries provide insurance, investment management, and other financial products and services to both retail and institutional customers throughout the united states and in over 40 other countries. приглашаем в компанию, а не в проект особенности проекта the client has recently started the development of a system that appeared to be in need of enhancements before its final implementation. the system is a warehouse consolidating data flows, and processing information so that it can be presented to the end user in a readable format. along with the optimization, the project is aimed at migration from on-premise software to cloud services (aws). we are the only vendor working on this task, and we need to expand the team. создаем среду, свободную от ограничений даем сосредоточиться на работе особенности позиции now we are looking for an experienced bigdata engineer who will be able to lead the team – support and assist with making decision according to project needs, as well as doing some coding. as the project is new, it provides a room for selecting the best technologies and stacks. still, the client has certain set processes which include the following technologies: apache spark, aws (s3, emr, redshift, kinesis), elasticsearch, git (bitbucket), scala programming language. we closely work with the architecture team on the clientchr(39)s side. the head of the architecture team is our key stakeholder. the team is dedicated to searching and making decisions on best practices to be implemented in development, and you can contribute to the start of large-scale development and proceed with the implementation of suggested approaches. стек технологий apache spark, aws (s3, emr, redshift, kinesis), elasticsearch, git (bitbucket), scala programming language. requirements solid experience in managing teams experience with at least three medium or large-scale data management solutions: dwh, bi, reporting, big data analytics, mdm, metadata management experience in data engineering, big data experience with etl and data integration toolsets understanding of systems architecture principles and best practices customer-centric attitude, attention to customer’s needs, willingness to understand and help good communication skills spoken english will be a plus experience with scala experience with aws (s3, emr) experience with databricks a desire to learn fast