#14537 | 2019-08-26 Virum, Denmark

Data Engineer (M/W)

For a client in the energy sector, we are looking for a data engineer.

Scope to be covered by the consultant:

  • Transform the delivered CSV files into Azure DW load format (Azure PolyBase based)
  • Simple SQL modelling.
  • Create model for handling documents connected to the SQL data model (assumed to be based on Data Lake storage gen. 2 BLOB to be accessed via http).
  • Create simple model for user access to data (assumed to be based to a simple Azure Power BI Dashboard).
  • Support the POC process to a stage where accepted by the stakeholders.
  • Build authorisations to restrict access to critical data (GDPS)

Data migration
  • Finalise the POC into production maturity.
  • Support the ongoing load process.
  • Adapt data type deviation as the occur during the data migration process.

Build/enhance user interface / reports.
  • Based on the developed data model.

General qualifications to solve the task:

General profile:
  • General understanding of DW/BI in an Azure Cloud technology environment
  • Experienced in Azure technology
  • SQL and data modeling
  • Data transformation in relation to loading data into the * Azure data containers
  • Experience with DataBricks (Python/SQL mapping) is an advantage

Data containers:
  • Azure DW
  • Azure SQL DB
  • Azure Data Lake storage gen 2 and BLOB storage

Data transformation:
  • Polybase (transformation and load data into Azure DW)
  • Python (data transformation)
  • Blob storage to handle documents/pictures etc. (incl. mime handling)

Data access:
  • Experienced with utilise Azure AD to protect access to data (authentication/authorisation)
  • Simple dashboards to support guided access to data.
  • SQL based access to support super users.

Start: ASAP
Duration: 30. Maj 2020
Work location: Virum, Denmark
Requirements: Min. 5 years of professional IT experience.
Job type: Freelance

Das Projekt ist nicht mehr vakant

Wir bedauern Ihnen mitteilen zu müssen, dass die Suche nach passenden IT-Beratern für dieses Projekt bereits abgeschlossen ist.

Bitte klicken Sie auf „Verfügbare Projekte“, um alle vakanten Projekte einsehen zu können.

Sie sind Kunde und auf der Suche nach einem ähnlichen Profil? Bitte nutzen Sie das Formular „Beraterprofil ansehen“ auf unserer Internetseite für Kunden.

ProData Consult uses own and third-party cookies for the purpose statistics, preferences and optimization of the website. Third parties may use cookies for targeted advertising. By accepting you give us your consent to the use of cookies. Read our Cookie Policy for more information. You can always withdraw your consent here: Impressum, Datenschutz & Cookies

The website requires the use of ‘Necessary cookies’. Our necessary cookies are only used for the purpose of deliver a proper functioning website and webservice.

Selected third parties may serve cookies on your computer or mobile device to allow relevant adverts to be delivered to you on third party websites.