this is just extortion isn’t it?
Ey nice power grid, be real unfortunate if someone were to use an excessive amount of electricity at peak times
this is just extortion isn’t it?
Ey nice power grid, be real unfortunate if someone were to use an excessive amount of electricity at peak times
probably because you dont use google to search tiktok lmao gottem
1 TOPS per watt seems more or less in line with what you can get out of an nvidia 4090. In fact with the right kind of data it looks like they’re pushing 2-3 TOPS per watt these days. Int8 with 50% sparsity can do 1.3 POPS (1300 TOPS) and the 4090 has a maximum power draw of 450 watts so that works out to about 3 TOPS per watt.
To Camdat’s point, a general transcription is definitely not low power even if you have some kind of gating on when it transcribes. Obviously Apple and Google and Samsung and whoever makes the phone can turn on the mic without you knowing, otherwise how would their voice assistant work, but Apple probably isn’t letting Facebook have access to the mic without throwing something up on the status bar.
I agree. If I was going to do something like this for advertising though I wouldn’t really care too much about what people were saying so instead I’d just listen for some limited set of keywords (maybe for some of my top paying advertisers) and serve ads for keywords that hit recently. Keep it all on device until an ad actually needs to be served.
Not that I disagree with your conclusion because there’s an even simpler way to check if an app is listening: iOS and Android will tell you the mic is being used… Anyway, we do have always-on NNs listening for keywords (“Siri,”, “Hey google”, “Alexa”) so I agree that full ass voice transcription like whisper will run like dogshit on your phone they can certainly run a much much lighter model to pick up a handful of keywords.
This is just a linkedin post transposed to a substack blog. The title and content are created through a mixture of madlibs and chatgpt.
also kinda weird that this guy’s brand is “retired amazon vp”
? looks like they approved it like a month ago…
poop