Data Engineer

Data Engineer

emagine Polska

Remote

B2B
Festanstellung

Hexjobs Insights

Data Engineer position in an international financial project focusing on data engineering in Azure. Requires 4+ years experience with Databricks and strong Python/SQL skills. Fully remote role based in Lisbon.

Schlüsselwörter

Data Engineer
Azure Databricks
Apache Spark
Python
SQL
Delta Lake
Azure Data Factory
ETL/ELT
Azure Data Lake Storage
CI/CD

The project:International project in the financial sectorData platform in Azure, with ADF and Databricks as coreStrong focus on data engineering, governance and qualityCritical platform in production, with high reliability and stability requirementsResponsibilitiesDevelop and maintain data pipelines in Azure Databricks (PySpark / Spark SQL).Implement and optimize Delta Lake tables (ETL/ELT, medallion architecture).Collaborate in the design of analytical datasets.Integrate Databricks workloads with Azure Data Factory (orchestration).Apply good practices in data performance, quality and reliability.Contribute to the evolution of the platform for analytics and AI scenarios.RequirementsAt least 4 years of experience as a Data Engineer.Hands-on experience with Azure Databricks and Apache Spark.Good knowledge of Python (PySpark) and SQL.Experience with Delta Lake.Experience with Azure services:Azure Data Lake Storage (ADLS Gen2),Azure Data Factoryfluent English (oral and written).Preferred:Experience with CI/CD for data platforms (Azure DevOps, Git).Notions of data governance (e.g., Unity Catalog, Purview).Sensitivity to safety, quality and regulated environments.Experience in international projects or distributed teams.

Aufrufe: 5
Veröffentlichtvor 8 Tagen
Läuft abin 2 Monaten
Art des VertragsB2B, Festanstellung

Ähnliche Jobs, die für Sie von Interesse sein könnten

Basierend auf "Data Engineer"

Keine Angebote gefunden, versuchen Sie, Ihre Suchkriterien zu ändern.