DATABRICKS SENIOR DATA ENGINEER

Company: Luxoft
Location: Baltimore
Posted on: October 26, 2024

Job Description:

Project descriptionWe are hiring for projects in the Middle East. The team comprises front-end and back-end developers, data analysts and data scientists, architects, analysts, and project managers. You will work with modern technologies and be an integral part of continuing to evolve our high-performing platforms. If you are serious about being a part of this fast-paced and exciting journey, this project should be top of the list! This role will be primarily responsible for closely collaborating with a business SME to implement data validation rules.Responsibilities

• Collaborating with a business SME to implement data validation rules.
• Understand business requirements and actively provide input from a data perspective.
• Understand the underlying data and flow of data.
• Understand overall platform architecture and capabilities and how to load data effectively.
• Recognize and adapt to the changes in processes.
  
  Read all the information about this opportunity carefully, then use the application button below to send your CV and application.
  SKILLSMust have
• 7 years + of relevant experience.
• Proficient hands-on experience with Azure Databricks (3y+).
• Proficiency in Python and PySpark (5y+).
• Advanced knowledge in SQL (5y+).
• Should be able to analyse and understand complex data.
• Knowledge of Azure data/delta lake, Azure DevOps, CI/CD, and Git is essential.
• Should clearly understand the data platform lifecycle and contribute to preparing Design documents, Unit Test plans, and Code review reports.
• Knowledge of data Lake house and business intelligence architecture.
• Experience working in an Agile environment (Scrum, Agile) is a plus.
• Interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.
• Bachelor's degree in IT/Computer Science or related field.
  Nice to haveKnowledge of the financial markets, portfolio theory, and risk management is a plus.
  #J-18808-Ljbffr

Keywords: Luxoft, Philadelphia , DATABRICKS SENIOR DATA ENGINEER, Engineering , Baltimore, Pennsylvania