Data Engineer (Azure), Asset Management Solutions

компания "dataart" dataart is assembling a project team for the logical continuation of the discovery and solution design phases we recently completed for one of europechr(39)s leading alternative asset management firms. dataart specialists were engaged to help build a new cloud-based data management and analytics platform. this project will allow you to work with top-notch data management technologies and architecture approaches. the main technologies are — azure data platform (azure sql, azure data factory, azure storage, azure functions); python/scala. dataart fully owns the stack and architecture ensuring the use of the latest best practices. requirements: 5+ years of engineering experience 2+ years working with data in the cloud, ideally using azure experience working with the azure data platform (azure sql, azure data factory, azure storage, azure functions) expertise in sql and comfortable designing, writing, and maintaining complex sql-based etl experience building batch and micro-batch data pipelines; etl design, implementation, and maintenance experience in writing python code experience working with git spoken english be plus understanding of data warehouse layers, approaches to load data into such layers, and relevant algorithms experience in designing a data platform architecture with relation to the infrastructure experience with schema design and data modeling, and analytical skills to qa the data and identify gaps and inconsistencies experience supporting business intelligence teams and products experience in parallel computing