Back to home

Things to Say

• There is a saying I learned in highschool, "a question well phrased is half solved". It has turned out to be a surprisingly useful problem solving tool at many places.
• “Don’t fear moving slowly. Fear standing still.”
• On LLMs: LLMs are a remarkable invention. It is THE MOST remarkable thing we have ever invented because we don't really understand how it works. My take on AGI debate is these LLMs are fascinating objects that can only REASON. We have made machines that can reason which is terrific but it can't produce new knowledge. So what we have right now is reasoning machines. AGI is the creative machine. Slope of progress after this creative machine would be unfathomably steeper than any tech growth slope ever. It would be almost a step function. All progress in LLMs is making better and better reasoning machines. Every "smarter" AI model is able to reason better than the last, but it has no progress in creativity. In a sense, reasoning already seems very mathematical looking at the amonunt of data available on the internet. We can go quite far in reasoning and it can totally transform the world. But keep in mind that AGI lies in a different domain.
• How to learn science: My framework of understanding the nature is being able to differentiate human knowledge vs natural knowledge. Human knowledge is convenience based. We define things in science so that science can be easy to work with, communicate with other people etc. While the natural knowledge is the understanding of the universe/nature itself. It is the intuitve understanding of the things and is made up of pictures and animations. It helps you see the fundamentals of what the univserse REALLY IS. It is the truth. Next time you try to learn anything keep this in mind. Differentiate conventions from ideas.