Senior BigData Engineer, Financial Software Solutions

компания "dataart" position overview our client is a new york city-based fintech startup that is building a trading and risk software platform for the investment banking industry to use in-house as an investment banking company and to sell the platform as a service. dataart has become the client’s main technology partner. we have constant work for the client and we plan to increase dataart’s team during the year. the processes in the project are built based on agile. the bigdata specialist will work on building a system for creating complex queries in a structured data warehouse system for the operations of quantum traders. core technologies: spark, python, java, aws, cloud architecture, apache airflow, hadoop, drill. requirements strong knowledge of big data general concepts strong knowledge of spark (core, sql, streaming) strong knowledge of java, scala or python strong knowledge of kafka strong knowledge of hadoop ecosystem chr(40)hdfs, map-reduce, yarn, hivechr(41) strong knowledge of nosql db (any popular) experience with aws spoken english