Is it okay if I leave a company just 2-3 days after joining? What would be the impact?

Yes, ok. In probation, exiting both ways works. They will blacklist you from rejoining at max. Don't quarrel much with HR, don't reveal your new company for about 6 months on LinkedIn, don't add this company in your experience. You should be good.