On-device Inference

On-Device Inference is an academic concept referring to the execution of machine learning inference directly on edge devices, distinguished from cloud-based or centralized inference by its reliance on local computational resources to enable low-latency, privacy-preserving, and energy-efficient AI deployment.

127

Publications

Citations

548

Authors

142

Institutions

Publications per year

2017–2026

121

Parents

Edge Artificial Intelligence

Publications

127

Distributed Deep Neural Networks Over the Cloud, the Edge and End Devices

Surat Teerapittayanon, Bradley McDanel, H. T. Kung · 2017 · 778 citations · Full text

Computing, Computer Science, Computer Systems +15

DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices

Nicholas D. Lane, Sourav Bhattacharya, Petko Georgiev et al. · 2016 · 402 citations · Full text

Computing, Computer Engineering, Computer Science +17

DeepX: A Software Accelerator for Low-Power Deep Learning Inference on Mobile Devices

Open MIND · 2016 · 300 citations

Computing, Computer Engineering, Computer Science +17

FLAME

John A. Gunnels, Fred G. Gustavson, Greg Henry et al. · ACM Transactions on Mathematical Software · 2001 · 235 citations

Computing, Computer Science, Computer Systems +14

Sparsification and Separation of Deep Learning Layers for Constrained Resource Inference on Wearables

Sourav Bhattacharya, Nicholas D. Lane · 2016 · 235 citations · Full text

Computing, Computer Science, Computer Systems +16

1–5 of 127

Authors

548

MX
Mengwei Xu
Beijing University of Posts and Telecommunications, China
6 publications · 132 citations
6
h-index
ND
Nicholas D. Lane
University of Cambridge, United Kingdom
6 publications · 934 citations
6
h-index
FK
Fahim Kawsar
Nokia (United Kingdom), United Kingdom
5 publications · 698 citations
5
h-index
AM
Akhil Mathur
Nokia (United Kingdom), United Kingdom
4 publications · 296 citations
4
h-index
MG
Matthias Grundmann
Google (United States), United States
4 publications · 176 citations
4
h-index

1–5 of 548

Institutions

142

1–8 of 142

Venues

arXiv (Cornell University)
Repository · 23 publications · 650 citations
14
h-index
Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies
IMWUT · 4 publications · 116 citations
4
h-index
Sensors
3 publications · 48 citations
3
h-index
IEEE Transactions on Mobile Computing
TMCCI · 4 publications · 75 citations
3
h-index
Proceedings of the AAAI Conference on Artificial Intelligence
Conference · 3 publications · 152 citations
3
h-index

1–5