компания "мэпдэйта" mapbox minsk r&d center (ooo mapdata) enables navigation for people, packages and vehicles. our underlying maps represent the ever-evolving world, accessing, aggregating, and adapting anonymous data from millions of sensors and phones in real-time. we are built on top of aws. we use tools like airflow for job orchestration and automate our tasks using lambda, ecs and pyspark applications on qubole. we store our data in s3 and are heavy users of hive. we use amazon athena to provide and measure our operational and qualitative metrics. we never shy away from building our own internal tools to accelerate our workflows. what you’ll do work with many geospatial data sets, specifically road networks, buildings, poi and address data implement distributed pipelines using airflow and spark to process geospatial data integrate third party data sources from different geographic areas into the basemap interface with engineers from other teams to analyze their needs for geospatial data and solve their data problems implement automated quality metrics to ensure we are continuously delivering high quality data to our customers participating in design and code reviews mentor other software developers to develop all aspects of their engineering skill sets create new data products by aggregating proprietary sources and derived data from sensors and aerial imagery what we believe are important traits for this role 3+ years of working software experience experience with aws or another cloud provider. proficiency in at least one modern programming language (python, scala, java, …) suitable for data processing proficiency in a query language like sql strong experience with data processing and developed judgement to implement new data pipelines and develop best practices around it. familiarity working with spark or other hadoop based technologies familiarity with ci/cd processes familiarity handling processing and normalizing many different datasets into a single coherent product. ability to communicate complex concepts to both peers and leadership. strong verbal and written communication skills. experience with introducing quality and operational metrics into a data etl pipeline. high performing team player that can create consensus. deliver key results quickly and resolve ambiguity in the customerchr(39)s favor. ability and willingness pivot to new languages, skills, techniques quickly. experience with geospatial data analysis and processing is a plus. experience with machine learning is a plus.if you are interested in this role, please send us your cv in english
Адрес
Белоруссия Минск