Data Engineer

Luxoft

About the job

Project Description

We are building a software development team for the Data Analytics department of a top tier international investment bank.

Responsibilities

We are looking for an individual contributor who is collaborative, communicates effectively, with experience developing Cloud native applications using Azure PaaS services and is well versed with Cloud application development best practices.

Skills

Must have

  • Demonstrable experience designing and developing big data applications using Apache Spark and Airflow
  • Experience leveraging Databricks to develop Spark based applications along with very good understanding about data engineering capabilities provided by the service
  • Excellent Python programming skills and experience delivering projects using PySpark is a must
  • Experience designing and developing Airflow DAGs, Operators etc…
  • Experience leveraging Azure Storage and Data Lake Store Gen 2 in Azure based big data projects along with integration to other Azure Data services
  • Experience designing and developing real time data processing applications using Spark streaming, Kafka, Event Hub etc..
  • Must have expertise on RDBMS solutions such as Oracle, SQL Server, Azure SQL DB etc.
  • Team player with excellent communication skills

Nice to have

  • Experience using Cloud data warehouse technologies such as Snowflake is highly desired
  • Scala programming experience
  • Experience in investment banking business domain
For example: I am very interested in the position at [company]. I believe my skills and work experience make me an ideal candidate for this role. I look forward to speaking with you soon about this position.
Upload your CV/resume or any other relevant file. Max. file size: 2 MB.


You can apply to this job and others using your online resume. Click the link below to submit your online resume and email your application to this employer.