Depends on your company culture. Most companies treat referrals as just a way for the recruiter to get pre-filtered profiles, so the candidate still has to go through the whole hiring process like any other. In this case they don't really who referred or what the quality of referrals are, so it doesn't matter whether you know the candidate personally.
Some companies treat referrals as a way to fast forward the hiring process because they trust their employees, and might skip on some rounds. In this case your referrals need to be real high quality and ideally you should've have worked/known the candidate beforehand.
In either scenario, just evaluate the profiles by yourself and judge whether you'd want to work with them or not and trust your company's hiring process. If it's a sub-par profile it'll anyway get reject without any impact on your reputation.