Luxoft
About the job
Project Description
We are building a software development team for the Data Analytics department of a top tier international investment bank.
Responsibilities
We are looking for an individual contributor who is collaborative, communicates effectively, with experience developing Cloud native applications using Azure PaaS services and is well versed with Cloud application development best practices.
Skills
Must have
- Demonstrable experience designing and developing big data applications using Apache Spark and Airflow
- Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service
- Excellent Python programming skills and experience delivering projects using PySpark is a must
- Experience designing and developing Airflow DAGs, Operators etc…
- Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services
- Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc..
- Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc.
- Team player with excellent communication skills
Nice to have
- Experience using Cloud data warehouse technologies such as Snowflake is highly desired
- Scala programming experience
- Experience in investment banking business domain
