There's so much happening every day. I never really like the AI/ML courses of college (lol) but want to actually try the new stuff now. What'd you say is the best way of at least knowing the basics of whatever comes up daily?
I know I could just google (and I will), curious to know if y'all know of something which defines the base vocabulary needed to actually understand the daily breakthroughs.
Few things I've been meaning to know more about
-
RLHF
-
Fine tuning (what and how)
-
LLM structure (should have kept up with LLM basics but I didn't lol, pls share stuff)
-
LoRA/QLoRA (?? idk lmao)
-
RAG (vectorisation of inputs + cosine similarity with query?)
-
Mamba architecture (1. what, saw on twitter, no idea)
Currently downloading https://ollama.ai/ to try running llama locally.
Any links/pointers/newsletter archives appreciated