Data Management

Key developments

1967–1998

Relational Foundations and Database Systems

Data management coalesced around the relational model and conceptual modeling to produce unified approaches to data design, querying, and integration. Researchers developed formal modeling languages, data independence, declarative query semantics, and unified views alongside engineering advances in modular storage and buffering. Distributed data management began to formalize cross-site coordination and event-driven processing while foundational work laid groundwork for knowledge bases. These developments established enduring paradigms that continue to shape modern database architectures and optimization practices.

Period 1967-1998: Researchers unified semantic modeling, distributed coordination, and relational engineering to scale declarative databases. Landmark conceptual frameworks and cost-based optimizations established enduring foundations for modern query processing and data integration.

1999–2010

Privacy and Security in Outsourced Data

Research focused on privacy-preserving analysis across partitioned datasets using secure computation and distribution-aware guarantees. Cryptographic enforcement enabled secure search and fine-grained access control through searchable and attribute-based encryption. Data anonymization and controlled release balanced utility with privacy in distributed settings. Trust, provenance, and auditing supported governance for outsourced and streaming data contexts.

Period 1999-2010: Researchers applied secure computation, cryptographic encryption, anonymization, and auditing to protect outsourced datasets. Landmark models, compression, verifiable possession protocols, and attribute-based encryption shaped scalable storage and secure cloud governance.

2011–2017

Privacy-Preserving Cloud Data Management

Researchers established a cohesive paradigm for privacy-preserving cloud data management by integrating cryptographic access control, revocation, and auditing into cloud storage systems. Attribute-based encryption, multi-authority schemes, and proxy re-encryption protected outsourced data while simultaneously enabling controlled sharing and collaboration. Encrypted search, indexing, and reversible data hiding advanced secure data handling across distributed environments. Provable data integrity mechanisms and auditing protocols further secured multi-cloud infrastructures and supported scalable data processing.

Period 2011-2017: Researchers protected outsourced data via ABE, proxy re-encryption, reversible data hiding, encrypted search, and multi-cloud auditing. Landmark auditing, blockchain, and benchmark datasets shaped subsequent privacy engineering and data-driven security.

2018–2024

Blockchain-Enabled Privacy Data Governance

Researchers integrated blockchain governance with privacy-preserving data sharing across healthcare, cloud, fog, and IoT environments. The field emphasized policy-driven access, auditability, and cross-institution interoperability through fine-grained encryption and distributed architectures. Investigators combined federated learning and data protection strategies with ledger-based governance to enable collaborative analytics without exposing raw data. These innovations established practical templates for data provenance, secure access control, and trustworthy multi-institution collaboration.

Period 2018-2024: Consortium blockchains, attribute-based encryption, and federated learning united privacy-preserving data sharing across health and IoT environments. Standardized datasheets, blockchain governance, and secure federated frameworks shaped subsequent multi-institution data provenance and collaboration.

Explore the full timeline

Key figures

Relational Foundations and Database Systems era

E. F. Codd and Peter Pin-Shan Chen

E. F. Codd conducted research while affiliated with IBM (United States) and IBM (United Kingdom). Through A relational model of data for large shared data banks and Extending the database relational model to capture more meaning, he established the relational model and extended its semantics to support data independence and declarative query foundations. Peter Pin-Shan Chen developed his work while at the Massachusetts Institute of Technology. With The entity-relationship model—toward a unified view of data, he advanced conceptual modeling to produce unified approaches to data design and integration.

Privacy and Security in Outsourced Data era

Brent Waters and 3 others

Brent Waters conducted research while affiliated with SRI International and The University of Texas at Austin. Through the paper Attribute-based encryption for fine-grained access control of encrypted data, he advanced cryptographic enforcement by enabling fine-grained access control in outsourced data environments. Amit Sahai pursued his investigations at the University of California, Los Angeles and UCLA Health. His contribution via the paper Attribute-based encryption for fine-grained access control of encrypted data helped establish attribute-based encryption mechanisms for secure access management. Vipul Goyal carried out his work at the University of California, Los Angeles and Microsoft (United States). He contributed to the era's focus on cryptographic security through the paper Attribute-based encryption for fine-grained access control of encrypted data by expanding fine-grained access control capabilities. Omkant Pandey undertook his studies while based at the University of California, Los Angeles. He furthered the development of security guarantees in distributed settings through the publication of the paper Attribute-based encryption for fine-grained access control of encrypted data.

Privacy-Preserving Cloud Data Management era

Nour Moustafa and Jill Slay

Nour Moustafa conducted research while affiliated with UNSW Sydney and the Australian Defence Force Academy. Through the publication of 2015, 3607 citations — UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set), they established benchmark resources for network intrusion detection systems to secure multi-cloud infrastructures and support scalable data processing. Jill Slay performed investigations concurrently at UNSW Sydney and the Australian Defence Force Academy. They contributed to the era by releasing 2015, 3607 citations — UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set), which advanced secure data handling across distributed environments.

Blockchain-Enabled Privacy Data Governance era

Kim‐Kwang Raymond Choo and 3 others

Kim‐Kwang Raymond Choo, working at The University of Texas at San Antonio and University of South Australia, investigated ledger-based security frameworks to address privacy challenges in distributed systems. Through Blockchain: A Panacea for Healthcare Cloud-Based Data Security and Privacy? and BSeIn: A blockchain-based secure mutual authentication with fine-grained access control system for industry 4.0, they advanced policy-driven access control and auditability for sensitive healthcare and industrial environments. Yan Zhang, affiliated with University of Oslo and Simula Metropolitan Center for Digital Engineering, contributed to collaborative analytics by integrating decentralized ledgers with machine learning. Their work in Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT established practical templates for privacy-preserved data sharing and multi-institution cooperation without exposing raw data. Sabita Maharjan, also based at Simula Metropolitan Center for Digital Engineering and University of Oslo, focused on distributed architectures for secure industrial networks. Through Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT, they helped advance federated learning and data protection strategies tailored for Internet of Things ecosystems. Xiaohong Huang, conducting research at Beijing University of Posts and Telecommunications and North China University of Science and Technology, advanced cross-institution interoperability and secure governance mechanisms. In Blockchain and Federated Learning for Privacy-Preserved Data Sharing in Industrial IoT, they demonstrated how ledger-based governance can secure collaborative data analytics across distributed industrial frameworks.

References

Key developments

Privacy and Security in Outsourced Data

Privacy-Preserving Cloud Data Management

Blockchain-Enabled Privacy Data Governance