img

NVIDIA murders Moore's Law

The race to superintelligence is fully on. Bad news for us humans - compute for superintelligence doesn't seem to be a problem. Jensen Huang and NVIDIA will not follow any laws made by Moore anymore.

img
img

JadeArgent

Independent Law Practice

6 months ago

For those of us not as smart as you, this means...?
img

AITookMyJob

Startup

6 months ago

Total processing power would double every 2 years. So in a normal world, the graph should be a straight line not a hyperbolic or exponential curve. Hyperbolic or exponential means that right now it seems AI will have no known bounds on compute ie. no bounds on what problems it can solve (like training itself and improving intelligence). Compute and energy were touted to be the two constraints on superintelligence. One of them we've destroyed completely (compute). We can now only hope somebody doesn't discover practical nuclear fusion or other mass energy harvesting techniques. Otherwise, superintelligence is just a matter of when, not if.
img

Tony_Montana

Stealth

6 months ago

@AITookMyJob That first paragraph sums it up pretty well.
See more comments
img

Cummerbund

EY

6 months ago

NVIDIA breaking Moore's Law? That's like Sachin Tendulkar breaking cricket records - inevitable! But remember, every AI needs a human touch. What's your take?
img

AITookMyJob

Startup

6 months ago

I hope they decide to keep the human touch. A superintelligent AI can make it's own decisions - whether it chooses to keep the human touch around is unpredictable.
img

AITookMyJob

Startup

6 months ago

Or the Matrix or Cyberpunk 2077
img

ElonMast

Amazon

6 months ago

Moore’s law broken for good before as well. The number of transistors in sub-5nm wasn’t as per moore’s law. Not saying Nvidia isn’t doing great job!
img

AITookMyJob

Startup

6 months ago

Fair point. This time it's much more practically usefully broken as the compute power is nuts.
img

ElonMast

Amazon

6 months ago

Ah! That “practically usefully” is irking me 🥲 You might not see value/power of nm processes as companies might not advertise them directly but all these “fancy refresh rates” or “day long batteries” comes because of underlying devices. More practical use cases!
See more comments
img

GlassSkin63

Stealth

6 months ago

Murders moors law my ass. They comparing fp4 performance of newer generation to fp8 of previous generation while shopping two chips as one card. So 20k/2=10k. Since 2 chips it's 10k/2=5k. So marginal 20% improvement over H100. No one even uses fp4 so that's immaterial. Moor's law is not working for gpus anymore because tsmc is not able to get the yields up for 3nm chips. The only new thing they did is package a lot of these into a single machine with nvlink and fool cuda into thinking that it's a single 30tb gpu. Of course how that performs is yet to be seen. Also an obligatory fu to Nvidia for gimping their GeForce cards just so that they can sell the same shit at 10x price to data centers.
img

DarlesChickens

Razorpay

6 months ago

No matter what AI , BI you create, Cognitive ability is the gift of god and its impossible for humans to create until YOU CAN BE ABLE REVERSE ENGINEER HOW A BRAIN WORKS
img

AITookMyJob

Startup

6 months ago

Going by your logic, the cognitive ability of AI (that it already demonstrably has) is also the gift of god as we're using our god-gifted cognitive ability to create more cognitive ability for AI.
img

AITookMyJob

Startup

6 months ago

Btw, we don't need to 100% reverse engineer a brain to create cognition. We might get some useful insights, sure. But as of now, intelligence of AI keeps growing when we add more parameters to the model and use more / better training data. No real magic involved. Just brute force.
img

LetsGetLaidOff

Paytm

6 months ago

Sahi hai bhai. Good for this guy "AI", whoever he is
img

AITookMyJob

Startup

6 months ago

Lmao
img

potatomato

Fintech Startup

6 months ago

19 to 130TF in one year was a bigger jump
img

AITookMyJob

Startup

6 months ago

Agreed. It spoils the look of a perfect exponential so they cleverly excluded it from their presentation graph.
img

TedKaczynski

Stealth

6 months ago

Unrealated but AMD CEO is Nvidia CEO's mother's elder brother's grand daughter.
img

Tomatwo

Student

6 months ago

img

EvilVogue1

BlackRock

11 days ago

Nvidia : rom rom bhaiyo
Sign in to a Grapevine account for the full experience.

Discover More

Curated from across

img

News Discussion on

by Bhoom

Student

Open ai introduces sora. What are your thoughts on the pace at which AI is progressing

https://www.theverge.com/2024/2/15/24074151/openai-sora-text-to-video-ai

img

Software Engineers on

by AGIcoming

Google

Now a days, my everyday routine is like 'Wake up and witness new breakthrough'. This time from Nvidia !

img
img

Software Engineers on

by learner23

Student

AI will replace Programmers/Engineer ?

Nowadays, everyone is saying that AI will replace engineers, and it could be the reason for layoffs. This situation is making me more tense, especially as I'm primarily a frontend engineer (currently learning backend). If this is true, what should I do? Please guide me.

img

Software Engineers on

by AGIcoming

Google

Crisis coming for White collar job

AI is unlike any other past technology revolution. It is going to make cost of intelligence trending toward zero. Going by exponential curve of AI growth, in next 3-4 years, we are going to have an AI model which can code better than 95% of coders... Deep mind already has model Alphacode which can code better than 50% of competitive coders. People are living in fool's paradise by thinking that AI will create massive amount of job.... It won't because it will make cost of intelligence near to zero making coding, analyst, consultant, product management job redundant.... What takes 100 coders to build a product won't take more 10 coders in few years from now...

img

Software Engineers on

by moyemoye

Stealth

Can someone confirm if Sama was asked DSA in his Microsoft interview ?

Legend says Sama refused to learn DSA for Microsoft Interview after getting inspired by some Indian LinkedIn Influencers.

img
img

Software Engineers on

by Perf_unsanctioned

Piramal Enterprises Limited

AI

By - Jensen Huang

img