What I learned and what to expect in your first job and project if you are new to data science
My Background
This is my very first real world data science project that I did in my first job straight out of university. I am a graduate Data Engineer and was given a small project to work on together with a Business Intelligence (BI) Analyst.
The Project
This project is reporting at operational level where I had to create a data warehouse for analysis. The goal is to develop a tool to help the rostering department to roster about 500 employees to a few hundred clients in their books. There are many complicated roster rules and factors to consider before assigning an employee to a shift. They did not have an efficient software resulting in a lot of overtime pay penalty, under rostered staff, inefficient rostering etc.
My Role
As a data engineer, my job is to:
- Extract data from the source
- Perform data wrangling
- Create data model suitable for analysis
- Ensure the reports are generated efficiently
- Communication with client
