2015 · 63 citations · 42 references
ComputingComputer EngineeringComputer ScienceComputer ArchitectureData StructuresParallel ComputingAccelerator ArchitectureData ParallelismHardware AccelerationMatrix ComputationParallel Numerical Linear AlgebraHeuristic ApproachMatrix MultiplicationParallel Matrix MultiplicationParallel Matrix-vector MultiplicationParallel Sparse Linear AlgebraTensor DecompositionsTensor FactorizationTensor Products
This paper describes a novel framework, called InTensLi ("intensely"), for producing fast single-node implementations of dense tensor-times-matrix multiply (Ttm) of arbitrary dimension. Whereas conventional implementations of Ttm rely on explicitly converting the input tensor operand into a matrix---in order to be able to use any available and fast general matrix-matrix multiply (Gemm) implementation---our framework's strategy is to carry out the Ttm in-place, avoiding this copy. As the resulting implementations expose tuning parameters, this paper also describes a heuristic empirical model for selecting an optimal configuration based on the Ttm's inputs. When compared to widely used single-node Ttm implementations that are available in the Tensor Toolbox and Cyclops Tensor Framework (Ctf), In-TensLi's in-place and input-adaptive Ttm implementations achieve 4× and 13× speedups, showing Gemm-like performance on a variety of input sizes.
42
Advances in Neural Information Processing Systems 28
Peter Flach, Meelis Kull · 2015 · 14.7K citations
Tensor Decompositions and Applications
Tamara G. Kolda, Brett W. Bader · SIAM Review · 2009 · 10.5K citations
Some Mathematical Notes on Three-Mode Factor Analysis
Ledyard R Tucker · Psychometrika · 1966 · 4.3K citations
Ivan Oseledets · SIAM Journal on Scientific Computing · 2011 · 2.6K citations