论文 | Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
相关文档
论文相关文章
- 论文：Modeling the Sequential Dependence among Audience Multi-step Conversions with Multi-task Learning in Targeted Display Advertising（AITM）
- 论文：A Survey on Large Language Models for Recommendation，大语言模型在推荐系统中的应用综述
- Preliminary and Motivation
- HLLM: Enhancing Sequential Recommendations via Hierarchical Large Language Models for Item and User Modeling
- Self-Attentive Sequential Recommendation（SASRec）
- 论文：LLaMA: Open and Efficient Foundation Language Models
- 论文：PatchFormer: An Efficient Point Transformer with Patch Attention
- Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting
- 论文：Actions Speak Louder than Words：Trillion - Parameter Sequential Transducers for Generative Recommendations HSTU
- 论文：TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
Transformer相关文章
- 论文：Perceiver - General Perception with Iterative Attention
- Swin Transformer
- Differential Transformer
- 论文 | TRANSFORMER - VQ: LINEAR - TIME TRANSFORMERS VIA VECTOR QUANTIZATION
- transformer 资料集锦
- 论文 | Fast Transformer Decoding: One Write-Head is All You Need
- 论文 | Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
- 论文 | TOKEN MERGING: YOUR VIT BUT FASTER
最近热门
- 常见的深度学习优化器Optimizer
- 论文 | DHEN: A Deep and Hierarchical Ensemble Network for Large-Scale Click-Through Rate Prediction
- GradNorm
- SO-PMI（Semantic Orientation Pointwise Mutual Information，情感倾向点互信息算法）
- kimi api
- NPU（Neural Processing Unit，神经网络处理器）
- vue3 vditor
- Straight-Through Estimator（STE, 直推估计器）
- 流匹配（Flow Matching，FM）
- 模型证据下界（Evidence Lower Bound，ELBO）
最常浏览
- 016 推荐系统 | 排序学习（LTR - Learning To Rank）
- 偏微分符号
- i.i.d（又称IID）
- 利普希茨连续条件（Lipschitz continuity）
- (error) MOVED 原因和解决方案
- TextCNN详解
- 找不到com.google.protobuf.GeneratedMessageV3的类文件
- Deployment failed: repository element was not specified in the POM inside distributionManagement
- cannot access com.google.protobuf.GeneratedMessageV3 解决方案
- CLUSTERDOWN Hash slot not served 问题原因和解决办法
×
![]()