On the Opportunities and Risks of Foundation Models

Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, +109

arXiv (Cornell University)

Artificial IntelligenceEngineeringMachine LearningAi FoundationAi Safety +18

PipeDream

Deepak Narayanan, Aaron Harlap, Amar Phanishayee, +5

Present PipedreamEngineeringMachine LearningHardware AccelerationAdvanced Computing +10

MLPerf Training Benchmark

Peter Mattson, Christine Cheng, Cody Coleman, +34

arXiv (Cornell University)

EngineeringMachine LearningMachine Learning ToolComputer ArchitectureHardware Systems +16

Holistic Evaluation of Language Models

Percy Liang, Rishi Bommasani, Dimitris Tsipras, +46

arXiv (Cornell University)

Llm Fine-tuningEngineeringCross-lingual RepresentationCore Helm ScenariosMultilingual Pretraining +16

MacroBase

Peter Bailis, Edward Gan, Samuel Madden, +3

Present MacrobaseManual InspectionMachine LearningData ScienceData Mining +13

PipeDream: Fast and Efficient Pipeline Parallel DNN Training

Aaron Harlap, Deepak Narayanan, Amar Phanishayee, +4

arXiv (Cornell University)

Training SystemConvolutional Neural NetworkDeep Neural NetworksEngineeringMachine Learning +13

Evaluating end-to-end optimization for data analytics applications in weld

Shoumik Palkar, James J. Thomas, Deepak Narayanan, +9

Proceedings of the VLDB Endowment

Cluster ComputingEngineeringIndustrial EngineeringComputer ArchitectureData Analytics Applications +19

Memory-Efficient Pipeline-Parallel DNN Training

Deepak Narayanan, Amar Phanishayee, Kaiyu Shi, +2

arXiv (Cornell University)

Multiple AcceleratorsEngineeringMachine LearningData ScienceHardware Acceleration +13

Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP

Deepak Narayanan, Fiodar Kazhamiaka, Firas Abuzaid, +5

Mathematical ProgrammingCluster ComputingLoad Balancing (Computing)EngineeringDynamic Resource Allocation +16

Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloads

Deepak Narayanan, Keshav Santhanam, Fiodar Kazhamiaka, +2

Operating Systems Design and Implementation

Cluster ComputingHeterogeneous ComputingEngineeringMachine LearningComputer Architecture +20