Data Governance with Azure Purview – A simpler integrated approach to your multi source data
[et_pb_section fb_built=”1″ _builder_version=”4.8.1″ _module_preset=”default” custom_padding=”3px|||||”][et_pb_row _builder_version=”4.8.1″ _module_preset=”default”][et_pb_column type=”4_4″ _builder_version=”4.8.1″ _module_preset=”default”][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”180px” hover_enabled=”0″ sticky_enabled=”0″]Organizations are collecting more data than they ever used to. According to a whitepaper by International Data Corporation, the volume of data generated per year is expected to grow to 175 zettabytes(ZB) by 2025. For reference, 1 ZB is 1 Billion Terabytes which also indicates that the need to manage it will also grow at an alarming rate. Imagine being part of a large organization having 100s of data sources, the data required to make Business decisions will be calculated from multiple sources and would involve transformation at various locations in its lifecycle. At a particular point in time, governing this complex system of integrated data landscape will become a challenging & time consuming process. [/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”180px” hover_enabled=”0″ sticky_enabled=”0″]
Managing the lifecycle of data from creation to the end point is a long process and requires huge investments, that includes creation of processes, adoption of new technologies and training people. A poor or inefficient governance plan will lead to the following problems– Poor Data Quality due to lack of clarity and process – Poor data visibility – No clarification on Data Ownership and Accountability – Disoriented definition and terms at different areas of the same organization
How do you tackle this without having any previous experience? Microsoft’s Azure purview is one such platform that can help you tackle your Data Governance nightmares. In addition to reducing the process time, Purview also simplifies the Data protection and complexity of Governance.
[/et_pb_text][et_pb_text admin_label=”Überschrift” _builder_version=”4.8.1″ _module_preset=”default” min_height=”53px” hover_enabled=”0″ sticky_enabled=”0″]
What is Data Governance?
[/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”148px” hover_enabled=”0″ sticky_enabled=”0″]Dataversity defines Data Governance as a collection of practices and processes which help to ensure the formal management of data assets within an organization. It includes areas & topics like Data Quality, Data Ownership, Data Management, etc. which help the organization gain better control over its data assets. It also includes methods to manage data efficiently and ensure security, privacy & compliance. Through a proper Data Governance process, companies can oversee the data flow within an organization and improve efficiencies as well as overcome regulatory scrutiny. [/et_pb_text][et_pb_text admin_label=”Überschrift” _builder_version=”4.8.1″ _module_preset=”default” min_height=”53px” hover_enabled=”0″ sticky_enabled=”0″]
Manage, govern and get more value out of your data with Azure Purview
[/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”98px” hover_enabled=”0″ sticky_enabled=”0″]In traditional setup of Data Governance, the process of data discovery is a tedious one, which takes weeks to complete and might need a reiteration if things go wrong. In a traditional setup there is no central location that registers the meta data. Users are not aware of the data asset or source until they have an actual use of it. A data asset’s use is not visible until the user is aware about it or it specified to him/her in a usecase. [/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”74px” hover_enabled=”0″ sticky_enabled=”0″]Moreover the documentation of the data asset lies in a different location. This make it difficult follow up on the different asset location and their definition (which differs across the organization).Additionally it is difficult to keep the data asset changes up to date in the documentation, you repeat the long same process again. [/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”74px” hover_enabled=”0″ sticky_enabled=”0″]
In terms of Data Owners or Data Stewards, if a user has questions related to a data asset, he/she must identify the responsible person for each of those assets and this might require lot of communication/documentation-reading efforts to identify the right person.
[/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”74px” hover_enabled=”0″ sticky_enabled=”0″]Microsoft introduced Azure Purview in 2020 as a unified solution for Data Governance. Azure Purview platform is a solution to simplify the discovery and compliance processes of Data Governance. It provides the following benefits. – Automated data discovery, lineage identification and classification – Unified map of your data assets across different sources and their relationships – Sensitivity labels to filter sensitive data assets – Hierarchy of Business Glossary – Data Discovery opportunity through glossary with business and technical terms – Insight into the sensitive data location and their movement across your organization [/et_pb_text][et_pb_text admin_label=”Überschrift” _builder_version=”4.8.1″ _module_preset=”default” min_height=”53px” hover_enabled=”0″ sticky_enabled=”0″]
Key components of Purview
[/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”74px” hover_enabled=”0″ sticky_enabled=”0″]You can connect to different platforms like Microsoft Azure, Power Platform, Microsoft SQL Server as well as OnPrem servers and get the flow of data across your organization. This means that you can evaluate the transformation lifecycle of your data, better known as Data Lineage The platform is also access based, so only those users who have permissions can view the Data flow across the organization, ensuring data security. Azure purview is comprised of three key components: Data Map, Data Catalog & Data Insights. [/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”74px” hover_enabled=”0″ sticky_enabled=”0″]Data Map: Purview addresses the problems of a traditional governance process and provides a Unified solution to view all the data assets & data sources at a centralized location. It is automatically kept up to date with built in automated scanning and classification. . You can visually trace the lineage of a data asset through movement, transformation at various systems in the cloud as well as from analytics tool like Power BI. [/et_pb_text][et_pb_image src=”https://hubsters.de/wp-content/uploads/2021/10/Purview_Blog_Grafik1.png” title_text=”Purview_Blog_Grafik1″ _builder_version=”4.8.1″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″][/et_pb_image][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”74px” hover_enabled=”0″ sticky_enabled=”0″]Data Catalog: The data assets includes glossary terms, business definition connected to them. Each asset includes the responsible owners and contact person who addresses that particular data related issues. The documentation is also synced with the data sources. With Data Catalog having inconsistent documentation is no longer a problem. You also have the option of filtering your data assets through sensitivity labels or filters. [/et_pb_text][et_pb_image src=”https://hubsters.de/wp-content/uploads/2021/10/Purview_Blog1_Grafik3.png” _builder_version=”4.8.1″ _module_preset=”default” title_text=”Purview_Blog1_Grafik3″ hover_enabled=”0″ sticky_enabled=”0″][/et_pb_image][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” min_height=”74px” hover_enabled=”0″ sticky_enabled=”0″]Data Insights: Data Insights provide users a single view into their catalog and provides specific insights to the sources, business users, data owners, Data stewards & security administrations. As of today, purview has six types of Insights reports that includes Asset Insights, Scan Insights, Glossary insights, Classification insights, Sensitivity labelling insights & File Extension insights. More in this will be explained in our future blogs. [/et_pb_text][et_pb_image src=”https://hubsters.de/wp-content/uploads/2021/10/Purview_Blog_Grafik2.png” _builder_version=”4.8.1″ _module_preset=”default” title_text=”Purview_Blog_Grafik2″ hover_enabled=”0″ sticky_enabled=”0″][/et_pb_image][et_pb_text admin_label=”Überschrift” _builder_version=”4.8.1″ _module_preset=”default” min_height=”26px” hover_enabled=”0″ sticky_enabled=”0″]
Conclusion
[/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]Purview addresses huge problem that is faced in the Data Governance processes. It is a one place solution and can help maximize the value of your organizational data. Through automated scans it simplifies data discovery process & decrease asset identification time. Since it is central repository for your meta data and business glossaries, it provides consistent data experience across the organization. [/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]The Data that you deal with will keep and increasing and so will increase the complexity to handle them. Azure purview helps ease this process by bringing some of the Data Governance practices to a single location. Today, data is the most valuable asset. Yet, its value is only utilized if you can manage to discover and identify data insights quickly. [/et_pb_text][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]To know more about the importance of Data Governance I’d like to refer to this link below, which will lead you to my 10 minute thought on data governance that i penned a couple of months ago. [/et_pb_text][et_pb_button button_text=”Data Governance Thoughts” _builder_version=”4.8.1″ _module_preset=”default” button_url=”https://hubsters.de/blog/a-10-minute-thought-on-your-data-governance-strategy/” hover_enabled=”0″ sticky_enabled=”0″ button_alignment=”center”][/et_pb_button][et_pb_text _builder_version=”4.8.1″ _module_preset=”default” hover_enabled=”0″ sticky_enabled=”0″]For the next articles about Purview as well as all the other content centered around knowledge exchange please make sure to click the yellow button below and sign up for our Newsletter. [/et_pb_text][et_pb_button button_url=”@ET-DC@eyJkeW5hbWljIjp0cnVlLCJjb250ZW50IjoicG9zdF9saW5rX3VybF9wYWdlIiwic2V0dGluZ3MiOnsicG9zdF9pZCI6IjIwOTQifX0=@” url_new_window=”on” button_text=”Join the News HUB” button_alignment=”center” _builder_version=”4.8.1″ _dynamic_attributes=”button_url” button_text_color=”#303344″ button_bg_color=”#efd430″ button_border_color=”rgba(0,0,0,0)” button_border_radius=”30px” button_letter_spacing=”2px” button_font=”Poppins|600|||||||” button_use_icon=”off” custom_padding=”16px|32px|16px|32px|true|true” animation_style=”slide” animation_direction=”right” animation_intensity_slide=”5%” hover_enabled=”0″ button_text_size__hover_enabled=”off” button_text_color__hover_enabled=”off” button_bg_color__hover_enabled=”off” button_border_color__hover_enabled=”off” button_border_radius__hover_enabled=”off” button_letter_spacing__hover=”2px” button_letter_spacing__hover_enabled=”on” button_border_width__hover_enabled=”off” sticky_enabled=”0″][/et_pb_button][/et_pb_column][/et_pb_row][et_pb_row _builder_version=”4.8.1″ _module_preset=”default” custom_margin=”|auto|-43px|auto||”][et_pb_column type=”4_4″ _builder_version=”4.8.1″ _module_preset=”default”][et_pb_divider color=”#303344″ _builder_version=”4.8.1″ _module_preset=”default”][/et_pb_divider][/et_pb_column][/et_pb_row][/et_pb_section][et_pb_section fb_built=”1″ _builder_version=”4.8.1″ _module_preset=”default” min_height=”199px” custom_padding=”0px|||||”][et_pb_row column_structure=”1_3,2_3″ _builder_version=”4.8.1″ _module_preset=”default” min_height=”218px” custom_padding=”||2px|||”][et_pb_column type=”1_3″ _builder_version=”4.8.1″ _module_preset=”default”][et_pb_image src=”https://hubsters.de/wp-content/uploads/2021/01/BIld2.jpg” alt=”Peter Schmäling” title_text=”BIld2″ _builder_version=”4.8.1″ _module_preset=”default”][/et_pb_image][/et_pb_column][et_pb_column type=”2_3″ _builder_version=”4.8.1″ _module_preset=”default”][et_pb_blurb title=”Tushar Poojary” _builder_version=”4.8.1″ _module_preset=”default”]
Tushar Poojary is a Junior Solution Architect at HUBSTER.S
[/et_pb_blurb][et_pb_blurb _builder_version=”4.8.1″ _module_preset=”default”]
[/et_pb_blurb][/et_pb_column][/et_pb_row][/et_pb_section]
