Data Engineer

Data Engineer

Voor deze job kan u niet meer solliciteren

Soort functie: Freelancer Locatie: Laakdal
Duur: Long Term Referentie: 202108965
Start: 29/09/2021

For our customer we’re looking for a talented Data Engineer.

In the first place we’re looking for candidates with the “Anankei DNA”.
Our DNA embodies a positive and joyful attitude.
Dream IT , Trust IT, Go for IT !

You'll be a part of the team in charge of building a data processing product (data pipeline), adopted across the organization, you will work closely with other Data, UI and DevOps engineers, with the Scrum Master, Product Owner, Architects and Engineering Manager.
The objective is to optimize its release cycle and improve user experience.

Your responsibilities :

- Design, implement, test and deliver robust, scalable and reusable data processing and ETL solutions
- Automate data extraction, transformation and provisioning, irrespective of type of source and target
- Participate to testing activities (create own test cases, manage test data, set up environments, etc., as no test engineers present in the team)
- Drive collaborative reviews of design, code, test cases and dataset implementation performed by other data engineers in support of maintaining data engineering standards
- Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues
- Mentor and develop other data engineers in adopting best practices
- Represent the team as technical ambassador
- Collaborates with the Data Engineering community to establish standards and best practices


Your Skills :

Technical :

- Last 3 years in data engineering (Python is a must)
- Experienced in structured & unstructured data, data lakes
- Great experience in Python Spark (have worked in the last 3 years)
- Good knowledge of SQL (preferably Hive) and No-SQL (preferably Dynamo DB)
- Good knowledge of scheduling and orchestration
- Good knowledge of cloud platform tools (preferably Amazon Web Services – AWS)
- Average knowledge of API & microservices in Python
- Good GitHub knowledge
- Ability to review complex big data architecture designs
- Average knowledge of DevOps (Kubernetes, Docker) and good knowledge of CI/CD (Jenkins)
- Good testing experience (unit test, component test, system test) with some of the most common tools in the market (PyTest, Nose, Behave, etc.)

Your Soft Skills :

- Good communication skills in English & Dutch
- Proactive and autonomous
- Experience working in multinational and multicultural environments
- Able to influence and interface with other teams and stakeholders (business or technical)
- Agile Mindset, preferably with experience working in Scrum

Officenter, Grauwmeer 1, bus 44
3001 Heverlee