Generative AI is the Interface for Software 2.0
Generative AI has a lot of unrealized potential. Most demos show incredible new abilities around computer usage. But that is different than computer programming. What can we do if we treat generative AI as a new way to program?
The most powerful application of language models is writing NLP apps
Language models could offer a new way of writing NLP apps, unlocking the vast amounts of knowledge in text all around us.
Labeling Data is a Mistake
The biggest problems in ML are with data. But labeling data is the least effective way to solve data problems.
Gating and Depth in Neural Networks
Depth is a critical part of modern neural networks. They enable efficient representations through constructions of hierarchical rules. By now we all know it so I’ll assume I don’t need to convince anyone, but in case you need a refresher it’s basically because we cannot efficiently model many data distributions that appear in the wild… Read more