2013 · 26 citations · 18 references
Mathematical ProgrammingArtificial IntelligenceCluster ComputingEngineeringMachine LearningDynamic Task PartitioningComputer ArchitectureParallel ImplementationMixture Of ExpertNatural Language ProcessingParallel SoftwareQuantum ComputingComputational LinguisticsMultilinear Subspace LearningMulti-task LearningParallel ComputingLarge Ai ModelMassively-parallel ComputingLoad BalancingComputer EngineeringLarge Scale OptimizationComputer ScienceDynamic LoadQuantum ChemistryTensor Contraction ExpressionsParallel ProcessingParallel ProgrammingData-level Parallelism
In this paper, we introduce the Dynamic Load-balanced Tensor Contractions (DLTC), a domain-specific library for efficient task parallel execution of tensor contraction expressions, a class of computation encountered in quantum chemistry and physics. Our framework decomposes each contraction into smaller unit of tasks, represented by an abstraction referred to as iterators. We exploit an extra level of parallelism by having tasks across independent contractions executed concurrently through a dynamic load balancing runtime. We demonstrate the improved performance, scalability, and flexibility for the computation of tensor contraction expressions on parallel computers using examples from Coupled Cluster (CC) methods.
18
Optimal scheduling for two-processor systems
E. G. Coffman, Ronald Graham · Acta Informatica · 1972 · 609 citations