Research
Improving LLM Quality
Model Architecture Mixture of Experts / Ensemble Zoph, Barret, Irwan Bello, Sameer Kumar, Nan D...
Learning Resources
Getting Started If you're starting from nothing. Just go to Wikipedia and start reading: https:...
Interpretability
Language Models Implement Simple Word2Vec-styleVector Arithmetic https://arxiv.org/pdf/2305.1613...