Freelance Data and Python Software Engineer

Gentofte, Denmark Asap 3 months

Om stillingen

The consultant will step into the E-ART, Team Cosmos, and work as a Data Engineer to ingest data in our energy client’s Data Eco system. You will be involved in administration of the ingestion of data through established data pipelines as well as working with tasks related to building new data pipelines.

 

Experience

• Writing data transformations using Python and SQL
• Software development – writing, testing and deploying code
• Cloud technology
• It will be considered beneficial with frontend development skills: Angular / JavaScript
• Expert understanding of ETL processes and data integration methods and tools
• Apache NiFi to extract source data from databases and file-based storage
• Ability to bridge multiple technologies to build end-to-end data pipelines
• Spark and Databricks, including cluster creation and dimensioning, job scheduling, and monitoring
• Monitoring data transformation jobs
• Data warehousing
• Cloud computing and file-based cloud storage
• Automatic data quality validation
• Running jobs using Docker and Kubernetes
• Streaming data pipelines and event queuing, e.g. Kafka or similar
• Working in a DevOps setting, including monitoring production systems

 

Assignment duration

Starting: asap

Ending: 31 October 2021

 

Location: Gentofte, Denmark

 

Please contact
Heidi Kelman Christensen
T: +45 5352 8899
E: heidi@dba-consult.dk

 

Please also upload your CV to our database:

https://exact.dba-consult.dk/contractor/sign_up?lang=en