Big data is dead?
Nithin Kamath undermining Data Analytics 🥺. https://twitter.com/Nithin0dha/status/1623575805719719936?t=Wm-TCKdo0DR7h-9hzV6bDQ&s=19
Also read this, https://news.ycombinator.com/item?id=34694926
As someone from this domain (Not a DA or DS) I kind of agree to what's being discussed here. Please read the links and let me know what do you guys think.
Depends on company to company. For tiktok and social media companies - it is must. For something like. Zerodha I don't see any need because that's what their philosophy has been.
I work in a company with quite a bit of use less (literally) data scientists. But that's true for all jobs / domains.
Big data was never alive for most companies. And most DA/DS work can be done by regular SWEs unless it's research or model validation.
Data engineering is definitely not dead. I work for a large retail chain in Australia and this is like bread and butter for retail industry. Everyday TBs for data gets processed for variety of usecases.
And obviously, this infra can only be developed after having your backend infra. So not a primary function but secondary for some industries, totally!