Ironside Group
  • Home
  • About
  • Ascent Solutions
  • Capabilities
  • Info & Events
  • Blog
  • Careers
  • Contact
  • Search
  • Menu Menu
Request a Meeting
Data Management

Metadata Demystified: A Bottom-Line Definition

metadata abstract concept connected points
March 25, 2016/by Ironside Group

What Is Metadata?

Metadata is a broad term referring to information about data. Its purpose is to provide us with an easily understandable context for the information we use. It answers questions we’re likely to ask about any source of data, such as where it comes from, how it’s generated, and when it was created. In data analytics, metadata comes in three main types:

Business Metadata

This consists of the business rules and concepts that define the terms we use to describe our data. It’s important because it allows business users to communicate about data in a way that’s meaningful and consistent. Say Sally is a data consumer at her company and she’s discussing requirements for a report with Paul, a developer. Sally asks Paul to create a report showing all transfers from retail stores to the main distribution warehouse due to seasonal inventory clear-outs. Sally explains that these orders are distribution orders from any of the retail store locations to the distribution warehouse and that post-season transfers are identified through a specific order type: 555. Retail store locations have a location type of ‘S’ and the distribution warehouse is location 5432. Sally’s explanation is business-related, and it allows Paul to understand specifically what data he needs to build into the report.

Technical Metadata

This refers to the locations, mappings, and specifications for technical data resources. Continuing with the previous example, imagine that Paul is unable to find the distribution order data required to create Sally’s report. Paul then meets with John, who is an analyst who has queried transfer data in the past for Sally. John explains to Paul that distribution orders are located in the LOC_TRANSFER_HIST table within the Global_Retail database, and that the location type information he needs is located in the LOC_DETAIL table. Paul is able to identify .. joined to .. on the field LOC_ID as the needed data source for the report. This information is technical, and it allows Paul to find and use the information identified by Sally’s business metadata.

Operational Metadata

This includes information about the execution and processing of data-related jobs and applications. The last execution time of a job to populate a database is an example of operational metadata. This can also refer to front-end resources. The amount of time a report takes to execute is also an example. Say Paul has developed Sally’s requested report and scheduled it to run and be emailed to Sally every Monday morning at 8am. However, Sally never receives the report. Paul can review the run history of the report to see that the report did run at the correct time but failed due to a connection issue. This information is operational. It helps Paul troubleshoot problems that arise in the data system.

The Value behind Metadata

weaving tapestry value of metadata concept

The three types of metadata mentioned above have different levels of importance for different people within a company, but all are vital parts of a high-functioning business analytics environment. Here are a few key reasons:

Data Governance

Good metadata allows for fast and accurate data analytics. It creates consistency in how a business understands and uses their data, and therefore is one of the primary tools used for data governance.

Bridging the Technology Gap

Data consumers need to be able to ask for the data they need and make use of it once they get it; however it is not practical or desirable for them to have in-depth knowledge of the underlying data structures. The solution is a good metadata framework, which provides consistent and understandable mappings from the business terms these users are familiar with to the technical data resources they need to access. When analysts and developers need to build applications and reports for consumers, good metadata resources provide a very efficient tool for converting business requirements into technical requirements.

Tracking and Troubleshooting

You just received a daily inventory report but something doesn’t seem right. Did the data update last night? How do you find out? Technical metadata allows you to trace back the data in that report to the source and operational metadata tells you when the source last updated and if there were any issues. These play a key role in defining the paths and flows of your data so that when there’s a problem, you can find it.

Metadata Problems

pile of rope disorder concept

There’s a lot that can potentially go wrong with metadata. Developing a layer that works with your environment and helps reveal/integrate your data assets is a complex science. Here are a few things to watch out for as you manage it:

Where Is It?

Metadata is ingrained in data analytics software and applications. The problem is rarely whether or not it exists, but rather where it is and how people access it. If users can’t access the metadata they need to answer their questions, then it might as well not be there. If users at your company are forced to ask vague questions about why data resources failed to deliver expected results, they may not have access to the information necessary to understand their issues.

Metadata Islands

Allowing different business areas to define their relevant metadata can be an effective practice for building it within a company, but be wary of creating islands where definitions from different business areas are incompatible. Maybe Finance claims a sale occurs when the payment posts but Retails says it is when the order is placed. Both may be useful definitions in their areas, but if you don’t have a method to reconcile them you can run into problems.

Inability to Adapt

Metadata needs to be able to grow and change as the business and data behind the business grows and changes. If it can’t be updated, it will quickly become stale and not only useless but potentially misleading and harmful. Avoid static resources in which changes can’t be made efficiently.

Tips for Success

fixing metadata cats cradle concept

There are a few easy ways to keep your metadata in control and avoid the pitfalls we just discussed. Here’s how you can ensure success:

Be Proactive

Metadata should be actively managed and accounted for through metadata management. This can be done in different ways depending on the business need, but it should not be ignored except in small operations where data is controlled by a very limited group of stakeholders. Even in those cases a lack of management will be a problem when the company grows or stakeholders change. When planning for any data project be sure to consider how you can effectively create and manage the metadata behind it.

Plan for Change

Acknowledge from the start that your business and the market you are in will change. If you want to keep up, your data is likely to change as well. As part of your metadata management plan you should include processes for reviewing and modifying it so it doesn’t become stale.

Keep It Simple

Recall that a primary function of metadata is to bridge technology gaps for consumers of data. Create an easy, user friendly interface for those consumers to access the metadata they need. This will allow them to answer some questions themselves and create more specific questions when calling on analysts and developers for assistance. This same principle applies to your processes for updating. If it is not easy for users to do, they will avoid doing it.

Next Steps

Now that you’ve got a handle on what metadata does in your environment and how you can take advantage of it, you can start seeing it as part of the larger analytics process going on at your organization. This includes both the back-end resources bringing you the data you transform and the front-end results you design. Ironside can help with both. Check out these additional resources:

  • The Dashboard Design DL: 5 Steps to Get Started
  • Get By with a Little Help from Empathy
  • ETL vs. ELT: What’s the Big Difference?
  • Do You Have a Big Data Problem?

governance how to cta


References

Metadata Management. (n.d.). http://www-01.ibm.com/software/data/metadata-management/

Bloor, Robin. “Does Big Data Mean Big Metadata?” Information Management RSS. 30 June 2014. Web.

Srivastava, Kumar. “The Grand Unified Theory of Metadata Governance.” CIO. 23 June 2015. Web.

Tags: Business Analytics, Business Intelligence, Data Modeling, Metadata
https://www.ironsidegroup.com/wp-content/uploads/2016/03/Network-Abstract-Resized.jpg 350 750 Ironside Group https://www.ironsidegroup.com/wp-content/uploads/2018/03/logo-with-words.png Ironside Group2016-03-25 11:50:172019-01-22 11:19:35Metadata Demystified: A Bottom-Line Definition

See 3 reasons why AWS analytics are well within your reach.

Recent Posts

  • Why outsourcing can make all the difference when it comes to successful data and analytics transformation
  • What’s keeping mid-market companies from leveraging advanced analytics and AI in 2023?
  • Learn Why So Many Companies Are Turning to
    a Hub-and-Spoke Data Model
  • Data governance presents big challenges in the mid-market
  • Mid-market Leaders Report Back from the Road

Categories

  • Awards & Recognition
  • Business Analytics
  • Data Management
  • Data Science
  • Featured
  • Technology Spotlight
  • Uncategorized

Newsletter

Ironside Follow

We make the world of business smarter. A trusted partner who turns data into valuable insights that drive positive business outcomes #Data #Analytics #AI #Cloud

IronsideGroup

Today's #Take30 #tbt dives into a use-case driven discussion of how #advancedanalytics integrates data from multiple sources to drive change in the eight areas of the #HigherEducation lifecycle. Check out the webinar with our partner @ibm here: https://irns.de/3Zdtdcz

Reply on Twitter 1639041567372775424 Retweet on Twitter 1639041567372775424 Like on Twitter 1639041567372775424 Twitter 1639041567372775424
Retweet on Twitter Ironside Retweeted

▶️ WATCH | Panelists at the CDO Midwest Summit 2022, share insights on accelerating innovation and using data and analytics as business drivers.
https://bit.ly/3IV0Vxm

@Rackspace
@BelcanGlobal
@SVB_UK
@MedOneInc
@IronsideGroup

✔️Check out our 2023 events here:

Reply on Twitter 1633195811294298112 Retweet on Twitter 1633195811294298112 1 Like on Twitter 1633195811294298112 Twitter 1633195811294298112

For today's #Take30 #TBT, we're revisiting our S.A.L.T. demo, exploring the powerful combination of #Snowflake, #Alteryx, & #Tableau and how it can be used to implement a #ModernAnalyticsFramework. Check it out here: https://irns.de/3leq2Dv

Reply on Twitter 1636480297045819396 Retweet on Twitter 1636480297045819396 Like on Twitter 1636480297045819396 Twitter 1636480297045819396

For today's #Take30 #tbt, we revisit our session on how the #Banking industry can utilize #advancedanalytics to help their business. Check out this clip to see the use cases our expert cover, and click the link for the full session! #DataScience https://irns.de/3L82JFS

Reply on Twitter 1633968390128664588 Retweet on Twitter 1633968390128664588 Like on Twitter 1633968390128664588 Twitter 1633968390128664588

We are happy to announce a new member of our #DataScience practice, Josh Angelchik. Bringing his experience from both the #consulting and #product sides at companies of all sizes, Josh can optimize existing data workflows and bring product ideas to life from scratch.

Reply on Twitter 1626644704887509005 Retweet on Twitter 1626644704887509005 Like on Twitter 1626644704887509005 Twitter 1626644704887509005

Ironside helps companies translate business goals and challenges into technology solutions that enable insightful analysis, data-driven decision making and continued success. We help you structure, integrate and augment your data, while transforming your analytic environment and improving governance.

LINKS

  • Home
  • About
  • Ascent Solutions
  • Capabilities
  • Info & Events
  • Blog
  • Careers
  • Contact

GET IN TOUCH

781-860-8840

GetInsights@IronsideGroup.com

Corporate Mailing Address
177 Huntington Ave Ste. 1703
PMB 89714
Boston, Massachusetts 02115-3153

131 Hartwell Ave
Lexington, MA 02421

Regional offices in Boston, New York City, Philadelphia, Austin, and Cincinnati

>>Managed Services Support

  • linkedin
  • twitter
  • youtube
  • mail
Also of Interest
  • self-service Archives
  • Got Standards? Master Data Management’s...
  • Ironside Tech Tip: Show Cube Sizes in...
© 1999-2022 Ironside Group. All Rights Reserved.
So What Is Data Discovery Anyway? 5 Key Facts for BIdata discovery mountain of data conceptrolling forecastingRolling Forecasting Starter Kit: 3 Essential Facts
Scroll to top
Send this to a friend