Biswajit Pal

 am heading the Data Engineering Analytics and insight practice for Tata Click. My core focus is on four verticals:

1. The first is around the data operations, which is about the day-to-day management of the data part.
2. The second is about developing a data governance layer on top, basically below the data ops. So, whenever the data is flowing from the source system into the data lake, there is a proper governance layer that tests the data and then the data goes into the lake.
3. The third aspect is about security because it's a commerce platform.
4. The fourth aspect is about the cloud cost optimization. As per our daily activities, we focus on the involvement of Generative AI in our routine tasks nowadays, especially whenever we are carrying out sentiment analysis, since no input is in standard format, we perform these three steps: Language Translation, Summarisation and sentiment Analysis.

5. With innovations and generative AI, though we feel that many conceptualities have been made easy, however, there are many challenges that we face, for example, consider doing sentiment analysis of customer reviews in the context of an Indian market. The reviews are usually in mixed English format and are interrupted with improper diction, and nowadays we have emojis everywhere. So, before we perform the actual operations we must standardise and rationalise it.

   I want to emphasize that for any Data Science activities to be fruitful, the core is the data pool. so we deliberately pay attention to enhancing data completeness, data quality and other data aspects. We constantly try to incorporate Data engineering and analytics inside that space. As Data engineers, we also look at historical numbers and sales figures because that helps us build models based on that for forecasting and making recommendations.