Author
Yonghong Tian
Recent research
- Health & MedicineOpen access
Abstract Language models are revolutionizing the biochemistry domain, assisting scientists in drug design and chemical synthesis with high efficiency. Yet current approaches struggle between small language models prone to hallucination and limited knowledge retention, and large c...
- AI & ComputingOpen access
State space model for new generation network alternative to transformers: a survey
Abstract In the post-deep learning era, the Transformer architecture has demonstrated its powerful performance in pre-trained large models and various downstream tasks. However, the enormous computational demands of Transformers have deterred many researchers. To reduce the compl...