Data Modeling

1980–1986 · 1 of 6

Semantic Hierarchical Data Modeling

1980–1986

Semantic Hierarchical Data Modeling

Contemporary themes

Conscious emphasis on semantic grounding and temporal integrity emerges as the core of data modeling, aiming to preserve meaning and timing across evolving datasets. Object-oriented approaches begin to influence modeling for engineering and CAD data, with early DBMS facilities supporting structured yet extensible representations. Extended non-first normal form hierarchies, dataflow architectures, and time-series methods drive scalable, distributed modeling and enable early forecasting and temporal analytics.

  • Semantic grounding and temporal integrity drive early data modeling, emphasizing semantic data models, abstract data types, and time-preserving approaches across foundational works.
  • Object-oriented (OO) data modeling emerges with OO approaches and database management system (DBMS) facilities for handling structured engineering entities and CAD (Computer-Aided Design) data architectures.
  • Non-first normal form (NF2) hierarchical data representations evolve with extended NF2 relations and integrated views across flat and hierarchical structures.
  • Dataflow (dataflow architectures) and parallel processing across distributed systems shape data modeling and scalable computation.
  • Time series analysis and forecasting anchor early data modeling with rainfall modeling and time-series methods.

Influential works

The period's combination of semantic sophistication and hierarchical data organization forged a bridge to later object-relational and semi-structured models. Efforts to unify flat and hierarchical views and to embed time-aware data representations nurtured advances in GIS, spatial databases, and multi-resolution indexing. Methodological work on dealing with noisy data and robust modeling pipelines established enduring practices in data quality, model validation, and reproducible analytics.

  • The Quadtree and Related Hierarchical Data Structures (1984) introduced the quadtree, a recursive spatial partitioning data structure enabling efficient range queries and dynamic updates for two-dimensional data, shaping GIS, graphics, and spatial databases and spurring multi-resolution indexing in data modeling
  • A DBMS prototype to support extended NF2 relations: an integrated view on flat tables and hierarchies (1986) proposed an extended NF2 data model to unify flat relational tables with hierarchical structures, addressing complex objects and informing later object-relational and semi-structured data modeling
  • Data models (1982) lays out the central role of data models in organizing, querying, and integrating information, articulating semantic modeling concepts that influenced subsequent database design, modeling languages, and data integration practices
  • Analysis of Messy Data, Volume I: Designed Experiments (1985) provides design methodologies for experiments with noisy, real-world data, emphasizing data cleansing, robust analysis, and repeatable modeling pipelines that shaped modern data quality and data science practices
  • Specification and testing of some modified count data models (1986) presents how to specify, fit, and test alternative count data models, offering practical model-checking frameworks that informed later statistical modeling and data analysis workflows

1987–1994

Semantic Object Modeling

Contemporary themes

In the late 1980s through the early 1990s, data modeling shifted toward semantically enriched and object-oriented representations, moving beyond flat relational schemas to capture richer interdependencies, constraints, and knowledge structures. Researchers pursued modularity and extensibility as core design principles, enabling scalable, reusable database architectures and more adaptable information systems. Approaches to uncertainty—via fuzzy logic, deductive modeling, and non-parametric reasoning—began to formalize semantics and enable inference within schemas, while dynamic, spline-based, and visualization-oriented modeling supported modeling of observational and scientific data.

  • Semantic data modeling (SDM) represents a shift from traditional record-based models to semantic and hypersemantic architectures that articulate richer interrelations, constraints, and knowledge representations across data systems.
  • Object-oriented data modeling (OODM) formalizes modeling as a universe of objects, classes, inheritance, and complex object relations, shaping late-80s to early-90s database design and system analysis.
  • Modularity and extensibility become central design concerns, with methodological frameworks for scalable, reusable design of databases and information systems.
  • Uncertainty and deductive reasoning enter data modeling via fuzzy relational models and deductive entity-relationship approaches, enabling formal semantics, constraints, and inference in schema design.
  • Dynamic, spline-based, and visualization-oriented data modeling targets observational dynamics and scientific visualization, employing adaptive splines and grid-aware representations for flexible data interpretation.

Influential works

The decade witnessed foundational shifts that would shape subsequent data engineering, including ontology-inspired semantic modeling and object-centric design that foreshadowed modern knowledge graphs and advanced data integration. Early adoption of rough-set theory and hierarchical/multilevel modeling introduced principled mechanisms to handle uncertainty and nested data, influencing later data mining, statistical modeling, and machine learning practices. The period's emphasis on flexible, visualization-driven representations presaged contemporary data science workflows that rely on expressive schemas, dynamic models, and interpretable inference.

  • Occam’s inversion: A practical algorithm for generating smooth models from electromagnetic sounding data (1987) introduced a principled regularization to pick the simplest, smooth model consistent with noisy observations, reducing overfitting and spurious discontinuities; its concrete algorithm popularized parsimony in inverse problems and influenced later model selection in data modeling.
  • Semantic database modeling: survey, applications, and research issues (1987) proposed semantic structures to represent complex interrelations beyond flat relational records, enabling richer schemas and knowledge representation; it laid groundwork for ontology and knowledge-base design, shaping semantic modeling and data integration.
  • Rough Sets: Theoretical Aspects of Reasoning about Data (1991) established rough-set theory to handle uncertainty in data via lower and upper approximations, providing a non-parametric basis for rule discovery and feature selection; it catalyzed data mining approaches and interpretable data modeling.
  • Hierarchical Linear Models: Applications and Data Analysis Methods (1993) introduced multilevel modeling for nested data, enabling within- and between-group inferences, random effects, and cross-level interactions; it transformed analysis of social, educational, and biomedical data and became standard in data modeling practice.
  • Fuzzy models for pattern recognition: methods that search for structures in data (1992) organized systematic use of fuzzy logic in pattern recognition to handle ambiguity, enabling robust data modeling and incremental learning; it influenced subsequent machine learning and data mining approaches.

1995–2001

Unified Object-Oriented Spatiotemporal Modeling

Contemporary themes

During this period, data modeling coalesced around unified object-oriented spatiotemporal approaches, using UML-based schemas to enable extensible, repository-like representations across geospatial contexts. Uncertainty and imprecision were modeled explicitly through fuzzy and uncertainty-aware data models, reflecting a shift from rigid schemas toward flexible, probabilistic representations. Integration of heterogeneous sources, evolving schemas, and probabilistic data association underpinned data pipelines, while temporal and spatiotemporal modeling frameworks supported time-evolving processes and misalignment; standardization efforts emphasized XML and UML repositories for cross-domain interoperability.

  • Object-oriented and UML-based conceptual modeling emerges as a unifying approach for geospatial and spatiotemporal data, enabling extensible field data models, repository-style schemas, and standards alignment across GIS contexts
  • Uncertainty and imprecision are systematically modeled through fuzzy relational modeling, fuzzy objects, and uncertainty-aware data models, reflecting a shift from rigid schemas to flexible representations
  • Data source selection, probabilistic data association, and dynamic data warehouse design illustrate integration of heterogeneous sources, probabilistic inferences, and evolving schemas to support data modeling pipelines
  • Temporal and spatiotemporal modeling frameworks address time, misalignment, and dynamic phenomena, advocating model-based approaches to capture spatially varying processes and time-evolving structures
  • Standardization and data exchange perspectives emphasize XML and UML-based repositories for interoperable data representations, enabling cross-domain sharing and governance of geospatial information

Influential works

Across periods, several breakthroughs anchored this era: Generalized Stochastic Petri Nets offered a rigorous stochastic-process formalism for causal, data-driven simulation of complex systems, informing dynamic modeling across disciplines. The joint modeling of longitudinal measurements and event times linked trajectories with time-to-event outcomes, reshaping prognostic inference and longitudinal data analysis. The Bayes Net Toolbox for MATLAB popularized probabilistic graphical modeling with accessible tools for inference and learning, while covariance-structure modeling of repeated measures refined multivariate inference.

  • Modelling with Generalized Stochastic Petri Nets (1998) introduced Generalized Stochastic Petri Nets (GSPN) as a powerful stochastic-process modeling formalism, enabling causal, data-driven simulation of complex systems. This framework shaped data modeling by providing a rigorous, scalable representation for stochastic dynamics, influencing later work in systems biology, queuing, and performance modeling.
  • Joint modelling of longitudinal measurements and event time data (2000) formulated a class of models that simultaneously analyzes repeated-measures data and survival times, capturing dependencies and informing prognostic inference. Its idea of linking longitudinal trajectories with time-to-event outcomes had a transformative effect on biostatistics data modeling and remains foundational in modern joint models.
  • The bayes net toolbox for matlab (2001) provided an accessible, feature-rich software platform for constructing and learning Bayesian networks, accelerating probabilistic data modeling across disciplines. By offering practical tools for inference, learning, and model selection, it catalyzed widespread adoption of graphical models and inspired subsequent software ecosystems.
  • Modelling covariance structure in the analysis of repeated measures data (2000) surveys and develops approaches to specify and estimate inter-measure covariance, improving accuracy of inference for longitudinal data. It influenced later multivariate and mixed-effects modeling by clarifying covariance specification and discussion of structure flexibility.

2002–2008

Unified Multimodal Data Modeling

Contemporary themes

During 2002–2008, researchers moved toward a unified data modeling paradigm that spans relational, multidimensional, and fuzzy representations to achieve cross-source consistency and flexible data representation. They advanced spatiotemporal data models and geometry-aware database architectures to capture space-time variation, hierarchical granularity, and irregular networks. Dimensionality reduction and manifold-based representations enriched data modeling, enabling low-dimensional embeddings and coherent cross-domain representations; time-series modeling with autoregressive and conditional Poisson frameworks addressed discreteness and overdispersion, while scalable data summarization and subset selection supported large-scale mining.

  • Converging toward unified conceptual data modeling and integrated structures spanning relational, multidimensional, and fuzzy domains, enabling cross-source consistency and flexible representation.
  • Development of spatiotemporal data models and geometry-aware DBMS architectures to capture space-time variation, hierarchical granularity, and irregular networks.
  • Dimensionality reduction and manifold-based representations underpin data modeling, enabling low-dimensional embeddings and coherent data representation across domains.
  • Autoregressive and conditional Poisson frameworks unify time-series count data analysis, addressing discreteness and overdispersion in multiple series.
  • Techniques for summarizing massive data and selecting representative subsets to preserve structure with reduced redundancy, enabling scalable data mining.

Influential works

Foundational ideas took form through the enduring emphasis on a principled data modeling language anchored by the entity-relationship model, which articulated entities, attributes, and relationships into a unified design framework. Breakthroughs in manifold learning, notably graph-based dimensionality reduction, provided robust mathematical underpinnings for learning and representing complex data spaces. Practical data engineering tools and workflows, exemplified by reshaping data with dedicated software packages, enabled consistent data preparation, testing, and deployment of modeling ideas across domains.

  • The Entity Relationship Model — Toward a Unified View of Data introduced the Entity-Relationship modeling framework, formalizing entities, attributes, and relationships into a coherent schema for database design and communication. It anchored contemporary data modeling practices.
  • Laplacian Eigenmaps for Dimensionality Reduction and Data Representation proposed a graph-Laplacian-based manifold learning approach that maps high-dimensional data to a low-dimensional space while preserving local structure, profoundly guiding data modeling and representation.
  • Reshaping Data with the reshape Package presents a practical framework for data transformation in R using melting and casting, enabling consistent reshaping, aggregation, and reformatting—critical steps in building and testing data models.
  • Visualizing Data using t-SNE introduced a scalable, nonlinear embedding technique that preserves local neighborhood structure to produce intuitive 2D/3D maps, catalyzing modern exploratory data analysis and data modeling practices.

2009–2015

Data-Intensive Spatial Modeling

Contemporary themes

During 2009–2015, data-intensive modeling and data-driven discovery unified diverse sciences by emphasizing large-scale datasets, information fusion, and automated extraction of knowledge as core drivers of predictive insights. Spatial and spatio-temporal data modeling dominated methodologies, enabling hierarchical and Bayesian inference for environmental, geographic, and urban processes. Data modeling infrastructures and standards, along with scalable processing frameworks, shaped interoperable and repeatable analyses, while advances in data reliability and stream representations addressed real-time and noisy data.

  • Data-intensive modeling and data-driven discovery unify diverse sciences, highlighting large-scale datasets, information fusion, and knowledge extraction as core drivers of predictive insights across domains.
  • Spatial and spatio-temporal data modeling dominates methodological patterns, enabling hierarchical, Bayesian, and panel-data inference for environmental, geographic, and urban processes.
  • Data modeling infrastructures, standards, and scalable processing frameworks shape interoperability and repeatable analyses, illustrated by data metamodels, integration platforms, and cloud-enabled query processing.
  • Data reliability and efficient stream representations address real-time and noisy data, through cleansing models, inference over RFID streams, and compact signatures for scalable data matching.
  • Semantic-rich information modeling and multi-scale representations enable cross-domain data integration with consistent semantics across scales, leveraging UML-based information models and topology-informed semantics.

Influential works

The Fourth Paradigm framed data-intensive scientific discovery as a central research paradigm, catalyzing cross-disciplinary approaches through large-scale data integration and analytics. Foundational methodological advances followed, such as sparse representation modeling and hierarchical Bayesian approaches for spatial data, which established efficient data representations and scalable inference for environmental and geographic analyses. Additionally, longitudinal structural equation modeling extended capabilities for tracking change over time, broadening applications in psychology and social sciences.

  • 'The Fourth Paradigm – Data-Intensive Scientific Discovery' (2012) advocates data-intensive scientific discovery, emphasizing large-scale data integration and analytics to redefine modeling; its data-centric framework catalyzed cross-disciplinary approaches and shaped modern data modeling across science and engineering.
  • 'Dictionaries for Sparse Representation Modeling' (2010) formalizes sparse signal representations via learned dictionaries, underpinning sparse coding and dictionary learning and driving advances across ML, imaging, and signal processing through efficient, interpretable data models.
  • 'Hierarchical Modeling and Analysis for Spatial Data' (2014) delivers a comprehensive Bayesian framework for spatial data, detailing CAR/SAR and hierarchical inference, transforming spatial statistics and environmental modeling with scalable probabilistic approaches.
  • 'Longitudinal Structural Equation Modeling' (2014) presents methods for modeling change with Structural Equation Modeling, including latent growth and longitudinal relationships, accelerating adoption of longitudinal SEM in psychology, social sciences, and beyond.

2016–2023

Physics-Informed Data-Driven Modeling

Contemporary themes

The 2016-2023 period is characterized by the convergence of data-driven modeling with physics-based constraints, enabling uncertainty-aware learning and cross-domain calibration from fluid dynamics to spatiotemporal inference. Bayesian inference and data assimilation unified model calibration with uncertainty quantification across domains, while data science infrastructure and open data practices promoted reproducibility and accessible toolchains. Reduced-order representations and data compression supported efficient, scalable simulations of dynamical systems, bridging data-driven approaches with engineering applications. The epistemology and methodology of data versus models, including mediation analysis and latent-variable approaches, shaped how data, models, and latent constructs are conceived, validated, and integrated in Modeling workflows.

  • Bayesian inference and data assimilation unify model calibration and uncertainty quantification across domains, from Reynolds-averaged Navier–Stokes models to spatiotemporal inference, enabling physics-informed learning.
  • Data science infrastructure and open data practices underpin cross-disciplinary modeling, promoting data management, reproducibility, and accessible toolchains (e.g., R data science workflow).
  • Data-driven modeling for time-dependent and dynamic systems relies on reduced-order representations and data compression to enable efficient, scalable simulations in engineering contexts.
  • Epistemology and methodology of data versus models, including mediation analysis and latent-variable approaches, frame how data, models, and constructs are conceived and validated.

Influential works

  • Datasheets for datasets (2021) introduced a standard, machine-actionable datasheet framework to document dataset provenance, collection, preprocessing, ethics, and licensing. This improves transparency, reproducibility, and data governance, enabling reliable data modeling and cross-project comparability; it has influenced practice across ML and data science.
  • Partial Least Squares Structural Equation Modeling (2017) presents PLS-SEM as a versatile alternative to covariance-based SEM, enabling modeling of latent constructs with smaller samples and non-normal data. It catalyzed widespread adoption in social sciences and marketing, shaping modern measurement and causal modeling.
  • Mediation analysis in partial least squares path modeling (2016) offers rigorous methods to test indirect effects within PLS path models, including bootstrap tests. This clarified mediation in PLS, improving validity of applied research and prompting broader methodological uptake.
  • Data-driven computational mechanics (2016) introduces a paradigm where material behavior is inferred from data rather than predefined constitutive laws, enabling data-informed simulations and model updating. This bridged data science with mechanics and inspired later physics-informed and data-driven modeling approaches.