2021 · 99 citations · 53 references
ComputingComputer ScienceArtificial IntelligenceEdge ComputingNatural Language ProcessingEdge Artificial IntelligenceLanguage ModelingLanguage ModelsLatency OptimizationMulti-task LearningNatural Language UnderstandingLarge-scale Natural Language ProcessingMemory DemandsMulti-task OptimizationScalable Edge PlatformsTransformer Language Models
Transformer-based language models such as BERT provide significant accuracy improvement to a multitude of natural language processing (NLP) tasks. However, their hefty computational and memory demands make them challenging to deploy to resource-constrained edge platforms with strict latency requirements.
53
SQuAD: 100,000+ Questions for Machine Comprehension of Text
Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev et al. · 2016 · 6.3K citations · Full text
In-Datacenter Performance Analysis of a Tensor Processing Unit
Norman P. Jouppi, Cliff Young, Nishant Patil et al. · 2017 · 4.4K citations
Song Han, Xingyu Liu, Huizi Mao et al. · ACM SIGARCH Computer Architecture News · 2016 · 2K citations