Mid Databricks Data Engineer @ RemoDevs
(práce v Polsku)

Mid Databricks Data Engineer @ RemoDevs

Polsko

• ​Proven commercial experience with Azure Databricks and Azure Data Factory (ADF).

• ​Strong proficiency in SQL and Python for data engineering.

• ​Hands-on experience in building data pipelines and data modeling.

• ​A good command of English (min. B2 level), enabling seamless communication within an international team.

• ​Experience with Agile methodologies and tools like Azure DevOps.

We’re looking for experienced Data Engineers to join a team delivering a strategic project for our client — a major leader in the Danish financial sector (insurance and pension funds). The projects goal is the full migration of existing data warehouse solutions from on-premises systems to a modern cloud platform based on Azure Databricks. You will be part of an elite team (5-8 engineers) working closely with the clients experts to transform their data landscape.

Your Responsibilities:

• ​Designing and implementing ETL/ELT processes within a Medallion architecture (Bronze, Silver, and Gold layers).
• Transforming and modeling data to create advanced data products used in insurance rate calculations, AI, and business analytics.
• ​Implementing Data Contracts to ensure data quality and consistency.
• ​Implementing data domains such as Agreements, Claims, Policies, and Customers.
• ​Creating tests (including automated tests) for data pipelines and data products.
• Collaborating with analysts and business stakeholders to understand and translate requirements into technical solutions.
• ​Establishing and maintaining development best practices for SQL, Python, and Azure Data Factory (ADF).
• ​Planning and tracking work in the Azure DevOps environment.

Requirements:

• ​Proven commercial experience with Azure Databricks and Azure Data Factory (ADF).
• ​Strong proficiency in SQL and Python for data engineering.
• ​Hands-on experience in building data pipelines and data modeling.
• ​A good command of English (min. B2 level), enabling seamless communication within an international team.
• ​Experience with Agile methodologies and tools like Azure DevOps.
  

Nice to Have:

• ​Knowledge of Azure Purview.
• ​Familiarity with data validation tools like Great Expectations.
• Certifications such as Databricks Certified Data Engineer Associate or Microsoft Azure Data Fundamentals (DP-900).
• ​Previous experience in projects for the financial, insurance, or pension sectors.

What We Offer:

• ​An attractive rate of up to 140 PLN/h (+VAT) on a B2B contract.
• ​A long-term, stable contract — the project is planned for a minimum of 18 months.
• ​A 100% remote work model with a flexible approach.
• ​The opportunity to work on a large-scale, international cloud migration project for an industry leader.
• ​Collaboration with a highly skilled team of engineers from both the client and Dateonic.

,[Designing and implementing ETL/ELT processes within a Medallion architecture (Bronze, Silver, and Gold layers)., Transforming and modeling data to create advanced data products used in insurance rate calculations, AI, and business analytics., Implementing Data Contracts to ensure data quality and consistency., Implementing data domains such as Agreements, Claims, Policies, and Customers., Creating tests (including automated tests) for data pipelines and data products., Collaborating with analysts and business stakeholders to understand and translate requirements into technical solutions., Establishing and maintaining development best practices for SQL, Python, and Azure Data Factory (ADF)., Planning and tracking work in the Azure DevOps environment.] Requirements: Azure Databricks, Azure Data Factory, SQL, Python, Azure DevOps

Kategorie

data

Odpovědět na inzerát