Ai2
allen_ai
We're releasing base, SFT, & DPO models plus a detailed report. Try them out and let us know what you find. 💻 Models: https://huggingface.co/collections/allenai/olmo-hybrid 📊 Data: https://huggingface.co/collections/allenai/olmo-hybrid 📄 Technical report: https://allenai.org/papers/olmo-hybrid ✏️ Blog: https://allenai.org/blog/olmohybrid
allenai.org
Introducing Olmo Hybrid: Combining transformers and linear RNNs for superior scaling | Ai2
Ai2, a non-profit research institute founded by Paul Allen, is committed to breakthrough AI to solve the world’s biggest problems.
huggingface.co
Olmo Hybrid - a allenai Collection
We’re on a journey to advance and democratize artificial intelligence through open source and open science.