Data Engineer( Andersen )

компания "andersen" andersen, an international it company, invites an experienced data engineer to work in a field of information technology and services. the project is to develop an application for international passenger, freight and long-distance transportation, courier delivery services, household and business solutions. the customer is an international passenger and cargo transportation service. it is among the top 3 mobile services for ordering rides in the world: 150 million installations, 1 billion trips, 600+ cities in 45 countries. technology stack: python and/or java, gcp, aws, microsoft azure, spark/flink/dataflow, luigi/airflow/oozie. responsibilities: data culture development; creating a unified system for data processing, storage and validation; designing and building processes for data storage, processing, cleaning and enrichment; participating in the development of the data pipeline at all stages (from discussions with data sources on the format of data retrieval, to presentation of new functionality to customers); api development (rest, grpc) for high-load data access services; participating in system design and architecture decisions with the development team; writing integration and unit tests, developing automation tools for validation and alerting based on data state. must-haves: experience as data engineer for 2+ years; experience of developing data pipeline on spark/flink/dataflow using luigi/airflow/oozie; experience with google cloud platform, aws, microsoft azure; proficiency in python and/or java; knowledge and understanding of algorithms and data processing principles; ️ understanding of general programming concepts (design patterns, oop, modularity, pure architecture, 12-factor app); ability to design a data modeling system; high level of responsibility and initiative; level of english – intermediate. reasons why this job would be interesting to you: experience in teamwork with leaders in fintech, healthcare, retail, telecom, and others. andersen cooperates with such businesses as samsung, siemens, johnson & johnson, bnp paribas, ryanair, mercedes, tui, verivox, allianz, t-systems, etc.; the opportunity to change the project and/or develop expertise in an interesting business domain; job conditions – you can work both fully remotely and from the office or can choose a hybrid variant; guarantee of professional, financial, and career growth! the company has introduced systems of mentoring and adaptation for each new employee; the opportunity to earn additional up to 1,700 eur per month by participating in the companychr(39)s activities; access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated; bright corporate life (parties / pizza days / playstation / fruits / coffee / snacks / movies); certification compensation (aws, pmp, etc); referral program; english courses; private health insurance and compensation for sports activities. join us!