Ejaaz
@cryptopunk7213
karpathy really is the fucking goat. - built an AI agent that autonomously self-improves while you sleep and made it FREE for anyone to use - we’re talking about an AI that gets smarter over night and runs itself. - executes 100 experiments (1 every 5 mins), if it gets smarter it upgrades if it doesn’t it discards and tries again. - only requires 1 gpu to run what i love abt this is it puts the power of training frontier intelligence into the hands of MORE people right now it’s all been about pay-to-play, you need to be openai or anthropic. this changes that (all be it in a small way) ---
Andrej Karpathy
@karpathy
· Mar 7
I packaged up the "autoresearch" project into a new self-contained minimal repo if people would like to play over the weekend. It's basically nanochat LLM training core stripped down to a single-GPU, one file version of ~630 lines of code, then: - the human iterates on the prompt (.md) - the AI agent iterates on the training code (.py) The goal is to engineer your agents to make the fastest research progress indefinitely and without any of your own involvement. In the image, every dot is a complete LLM training run that lasts exactly 5 minutes. The agent works in an autonomous loop on a git feature branch and accumulates git commits to the training script as it finds better settings (of lower validation loss by the end) of the neural network architecture, the optimizer, all the hyperparameters, etc. You can imagine comparing the research progress of different prompts, different agents, etc. github.com Part code, part sci-fi, and a pinch of psychosis :)
