TechnicallyBehind
TechnicallyBehind

Staying up to date with AI happenings (how)

There's so much happening every day. I never really like the AI/ML courses of college (lol) but want to actually try the new stuff now. What'd you say is the best way of at least knowing the basics of whatever comes up daily?

I know I could just google (and I will), curious to know if y'all know of something which defines the base vocabulary needed to actually understand the daily breakthroughs.

Few things I've been meaning to know more about

  • RLHF

  • Fine tuning (what and how)

  • LLM structure (should have kept up with LLM basics but I didn't lol, pls share stuff)

  • LoRA/QLoRA (?? idk lmao)

  • RAG (vectorisation of inputs + cosine similarity with query?)

  • Mamba architecture (1. what, saw on twitter, no idea)

Currently downloading https://ollama.ai/ to try running llama locally.

Any links/pointers/newsletter archives appreciated

10mo ago
roct
roct

Also, looking at your comment it's kinda obvious that you have little foundations so I'd recommend doing a course on ML and DL first. Checkout Andrew's course on Coursera

TechnicallyBehind
TechnicallyBehind

@roct Yeah, I'm a dumbass in these haha. Will check it out. Thanks for the other recs as well

roct
roct

Haha, np. It's a long, not so easy road but it's cool to learn new stuff. Good luck 🤞🏼

roct
roct

Hard but the best way: Assuming you have enough foundational knowledge about AI/DL, start reading research papers. Follow youtubers that read/analyse new and popular papers like Two Minute Papers, Yannic Kelcher, etc. You can also follow industry experts like Andrej Karpathy (X and YouTube). Join subreddits in your topic of interest

Discover more
Curated from across