Unveiling ProtHyena: A Fast and Efficient Protein Language Model for Analysis at Single Amino Acid Resolution
The field of biological sequence analysis has lately benefited from the revolutionary changes brought about by the development of self-supervised deep language models for natural language processing tasks. Conventional models show significant effectiveness in a variety of applications. These models are mostly based on the Transformer and BERT architectures. However, the quadratic computational complexity O(L2)…
