• 278 Posts
  • 384 Comments
Joined 4 years ago
cake
Cake day: June 28th, 2020

help-circle




  • We are not making anyone move. I and the rest of the mods but wabooti who is MIA for 8 months have already left. It’s a courtesy notice to the community. Whether wabooti will continue is up to him. I will just stay here long enough for the discussion, if any.

    You can of course make your own collapse community (with blackjack and hookers) but perhaps pick an instance where the admins are not overshoot deniers. It seems though you don’t quite understand the significance of that “slap on the wrist”.




























  • A free running cellular automaton (CA) approach in hardware would work, but each cell would be a much souped up SRAM cell, the interactions would be all local and 2D. Considering Cerebras is 40 G SRAM on the 300 mm WSI and is about at the cooling limit I’m afraid you do not have 5 orders of magnitude. Perhaps reversible spintronics can help with the power draw, but you still have to splat a higher dimensional network so not just local interactions into a 2D array.









  • There are diminishing returns in semiconductor photolitho. Moore scaling is long over, absolute real estate see WSI with Cerebras, DC costs and power envelope are all sending a clear message. Quantization is there, so you can go from digital multipliers to analog and go spiking networks, but transformers and Co have little power there.

    Also, the kind of economy that can carry Gen AI as business model is not a given, long term.