Freelance Data Engineer

Position description
The data engineer is responsible to analyse data demand, create the required database design and develop the ETL processes from various sources to the database of our IT Security monitoring solution using Python, Kubernetes, Alteryx and Airflow. The data engineer is responsible to transform the data into a structured and clean database.

Duties
•    Analyse data sources;
•    Develop ingest flows for data containing transformation, (de-) normalization and cleaning;
•    Design and develop the data structure, database tables / datasets / views;
•    Crreate python code running on Kubernetes and scheduled by Airflow to ingest the data into the developed structure;
•    Create transformation scripts in python running on Kubernetes and scheduled by Airflow to transform the ingested data into the right structure that can be used within the organization;
•    Document your flows adequately;
•    Facilitate good governance to move the developed artefacts to production;
•    Ingest scripts are built in Python and/or Alteryx;
•    Ingest scripts will be scheduled on Alteryx server or Airflow based on the language.

Required skills and experience
•    At least bachelor degree in Information Technology or similar;
•    At least 3 years of professional experience required in an international business environment and a similar position;
•    A team player with excellent communication skills and creative mentality;
•    Experience with databases, ETL processes, data warehouses, data modeling;
•    Solid knowledge and proven experience with SQL, Python, Apache Airflow and Linux
•    Basic knowledge of Alteryx;
•    Experience with Azure DevOps Server and GIT including creating pipelines for build and release processess;
•    Experience with Agile environments, DevOps and Scrum would be a preference;
•    Fluency in English (spoken and written).

About Viterra
Our world-leading, fully integrated agriculture network connects producers and consumers to supply sustainable, traceable and quality-controlled agricultural products. With our talented people, decades of experience and diverse capabilities, we offer innovative solutions to open pathways and create value for customers through our supply chains. As a responsible long-term business, we will continue to invest in and develop our network, allowing us to meet the needs of a growing world.Together, we are stronger and achieve more.