METADATA MANAGEMENT CONSULTING

Managing metadata is not just managing the storage of data but also managing its meaning, quality, and the lifespan of the data.

Metadata Management strategy is a key component of data strategy. Metadata is information of data that includes business definition, valid values (data domains), business rules for creating the data, transformation and aggregation rules, security, data ownership, source, timelines, and data formats.

 

Metadata Categories (1)

Descriptive Metadata: Descriptive metadata is information that describes data so people can understand, find, and use it easily.

What descriptive metadata includes (e.g., for a dataset)

  • Title of the dataset
  • Description of what the data contains
  • Purpose for which the data was created
  • Subject or domain (e.g., finance, healthcare, sales)
  • Owner of the data
  • Business definitions of key data fields
  • Keywords or tags to support search

Structural Metadata: Structural metadata describes how data is organized, related, and structured, so systems and people understand how data is put together.

What structural metadata includes (e.g., for a dataset)

  • Tables, files in a dataset
  • Columns and their order
  • Hierarchies (parent–child structures such as database, schema, tables, columns)
  • Relationships (primary keys, foreign keys)
  • Administrative/ Auditing metadata: created date, created by, update date, etc.
  • Lifecycle metadata: status, articulation score, etc.

Administrative Metadata: Administrative (or Auditing) Metadata describes how data is managed, accessed, and controlled. In other words, the “rules and history” around the data.

  • Access and permissions of dataset – who can view, edit, or delete the data
  • Ownership and stewardship – who is responsible for the data
  • Data sensitivity classification – public, internal, confidential, or restricted
  • Audit trails / history – records of who accessed or changed the data and when (create/ update dates)
  • Retention and lifecycle rules – how long the data must be kept or archived
  • Versioning – tracking different versions of datasets or records
  • Compliance information – GDPR, HIPAA, or other regulatory requirements

Lifecycle metadata: Lifecycle metadata tracks the state and history of a data asset through its lifecycle. Essentially, it documents where the data asset is in its life journey with its status and helps manage it properly.

  • Creation details: When and how the data asset was created (in Data Catalog)
  • Audit trails / history – metadata records of who changed the metadata and when
  • Metadata Quality / Validation status: Has metadata been validated?
  • Lifecyle status: Data asset goes through different statues (drafted, initiated, under review, approved)

 

Metadata Categories (2)

Business Metadata: Business metadata, contributed by SMEs, conveys the business meaning of data to ensure a consistent contextual understanding across diverse data sources and applications.

Technical Metadata: Technical metadata, generated by technology (sometimes provided by technology team), is captured in technical formats within databases and applications, often abbreviations, shorthand, or character delimiters such as underscores, dashes, etc.

Process Metadata: Process metadata functions as technical documentation primarily for the technology community. It specifies actions performed by programs on data elements that include edit-routines, derived column calculations, data quality corrections, or data transformations. The process metadata is typically found in ETL tools, reporting tools, OLAP tools, etc.

Usage Metadata: Usage metadata records data access patterns and frequencies by both users and programs, enabling monitoring of who accesses specific data, how frequently, and at what times data is accessed.

Metadata Management Platform Implementation connects business and process metadata to technical metadata. Usage metadata is eventually added.


Managed Metadata Platform Implementation

Metadata Management Platform implementation addresses key challenges that any organization faces with its five architectural components.

  • Metadata Sourcing
  • Metadata Linking
  • Building Metadata Repository
  • Metadata Change Management
  • Metadata Delivery/ Publication

Metadata Management Consulting @ 1lessclick®

  • 1lessclick® makes metadata useful, not just stored.
  • 1lessclick® turns metadata into value once it is made available .
  • 1lessclick® delivers clear ROI when metadata is used.
  • 1lessclick® keeps metadata up to date, making it a true enterprise asset.
At 1lessclick®, Data is the true and lasting source of value independent of systems and applications.

Metadata Management Consulting

Metadata Management strategy is a key component of data strategy. Metadata is information of data that includes business definition, valid values (data domains), business rules for creating the data, transformation and aggregation rules, security, data ownership, source, timelines, and data formats.

Questions that drive usage of data catalog.

Data Catalog gives a central portal to collect answers to these questions.
  1. I need the data, can you confirm if we, have it?
  2. Where should I go to access the data, I need?
  3. I am looking for this data, Is it currently accessible to us?
  4. What confirms that the data I am using is accurate and appropriate?
  5. How can I evaluate whether the data is fit for my business purpose?
  6. Who is responsible for clarifying any uncertainties about the data I am working with?

Three broad categories that encompass data catalog and its functionality.

  • Descriptive metadata: Name, location, description, size, author, etc.
  • Structural metadata: relationships
  • Administrative/ Auditing metadata: created date, created by, update date, etc.
  • Lifecycle metadata: status, articulation score, etc.
At 1lessclick, we establish clear-cut definition and communication of Metadata. There is a sense of understanding of metadata from its repository because metadata will not simply govern itself. The important part is to communicate the relationship between data governance and metadata management across the enterprise community.  
Power statement: Managing metadata is not just managing the storage of data but also managing its meaning, quality, and the lifespan of the data.
  • At 1lessclick, we will take you on a journey of capturing and integration of four broad categories of metadata.

Business metadata

Business metadata is provided by the end users. Business metadata supplies business meaning associated with data to ensure that consistent business context is maintained across different data sources and applications.

Technical metadata

Technical metadata is provided by technology and is documented in technical terms in databases and applications. They can be abbreviated, short formed and separated by characters like underscores.

Process metadata

Process metadata is considered as technical documentation serving only for the technology community and hence provided by technology. Process metadata describes an action taken by a program on a data element. The action can be an edit routine, calculation of a derived column or it can be a transformation. The metadata can be found in ETL tools, reporting tools, OLAP tools, etc. Dataset can be classified under a process metadata where one can tell

Usage metadata

The usage metadata documents data access pattern and access frequency by people and programs. Using usage metadata, one can monitor who accesses what data, how often and when.

Metadata Management Platform hosts the integration of all four categories of metadata.

Metadata Management Platform Implementation connects technical and process metadata to business metadata. Usage metadata is eventually added.
  • Business concept: Average Monthly Balance
  • Business Term/ Definition: Average Monthly Balance
  • Data Quality Rule:
  • Data Dictionary/ Data Source/ Physical Data Attributes
  • ETL/ ELT Processes/ Transformation (Derivation, Computation)
  • Data Lineage
  • Reports/ Model (How data is used)

Managed Metadata Platform Implementation

Metadata Management Platform implementation addresses key challenges that any organization faces with its five architectural components.

Metadata Management Platform implementation addresses key challenges that any organization faces with its five architectural components.

  1. Metadata Sourcing
  2. Metadata Linking
  3. Building Metadata Repository
  4. Metadata Change Management
  5. Metadata Delivery/ Publication
Power statements throughout the pages
  • Metadata only becomes useful if it’s recorded
  • Metadata only becomes valuable if it’s made available
  • Metadata only demonstrates ROI if it is used.
  • Metadata only becomes an asset if it has kept up-to date.

Questions about Metadata tooling

Metadata Management Platform Implementation connects technical and process metadata to business metadata. Usage metadata is eventually added.

  1. What are your metamodel and software releases
  2. Extensibility
  3. Self-defined goals
  4. Roles’ representation
  5. Process integration
  6. Training education
  7. Resources requirements
  8. End use requirement
  9. Communications
  10. Change control and versioning

Cost of Value: How much the metadata management will cost?

Value from Cost: How much value will the metadata management deliver back to business and technology?

Power statement: Data is a primary and permanent source of value and not the systems and applications.