5003.大模型-基础架构-hyena鬣狗

https://ermongroup.github.io/blog/hyena/
https://arxiv.org/pdf/2302.10866
https://colab.research.google.com/github/expz/annotated-hyena/blob/master/annotated_hyena.ipynb#:~:text=The%20Hyena%20architecture%20is%20an%20exciting%20development%20that,layers%20in%20transformer%20models%20enabling%20long-range%20sequence%20modeling.