Apache Spark

Matei Zaharia, Reynold Xin, Patrick Wendell, +11

Communications of the ACM

Open Source SupercomputingEngineeringData ScienceOpen SourceData-intensive Platform +11

Spark SQL

Michael Armbrust, Reynold Xin, Cheng Lian, +8

Spark SqlEngineeringApache SparkSemantic WebDatabase System +14

MLlib: Machine Learning in Apache Spark

Xiangrui Meng, Joseph K. Bradley, Burak Yavuz, +13

arXiv (Cornell University)

Cluster ComputingEngineeringMachine LearningMachine Learning ToolPresent Mllib +17

CrowdDB

Michael J. Franklin, Donald Kossmann, Tim Kraska, +2

EngineeringSemantic WebComputational Social ScienceInformation RetrievalData Science +15

GraphX

Reynold Xin, Joseph E. Gonzalez, Michael J. Franklin, +1

Cluster ComputingEngineeringMachine LearningTargeted AdvertisingNetwork Analysis +17

Shark

Reynold Xin, Josh Rosen, Matei Zaharia, +3

Cluster ComputingEngineeringComputer ArchitectureMap-reduceData Science +14

Structured Streaming

Michael Armbrust, Tathagata Das, Joseph Torres, +6

Cluster ComputingSpark SqlEngineeringStructured StreamingData Streaming Architecture +15

Delta lake

Michael Armbrust, Tathagata Das, Liwen Sun, +18

Proceedings of the VLDB Endowment

Cluster ComputingCloud Object StoresDelta LakeEngineeringData Science +11

Finding related tables

Anish Das Sarma, Lujun Fang, Nitin Gupta, +5

Large CorpusEngineeringSemantic SearchStructured DataTable Search +16

Shark

Cliff Engle, Antonio Lupher, Reynold Xin, +4

Cluster ComputingEngineeringShared-memory AbstractionComputer ArchitectureApache Hadoop +15