Structure: DEMO??? What is a data marketplace Context of a data warehouse Business catalog vs internal marketplace Creating data products Publishing data products Is this data-mesh??? Access??? Final Thoughts DEMO What would the demo be about? Take the persona of two different business user persona Marketing Data Scientist Explore the data catalog Knowing who to request for data Knowing who to contact for data context Data approval process
TLDR Every corporationg have their own network securities polcies, they use network proxies to control and monitor the traffic going in and out of their network. Just assume that the proxy will be different corporation. When working with Snowflake Privatelink, you will have to get the proxies to whitelist the Snowflake private endpoints. This will only provide you access to Snowflake when interacting directly with Snowflake. When using IaC tools like Terraform, you will have to configure the proxy settings in your local environment so that Terraform can access Snowflake endpoints via the corporate proxy. This is the simple part, as you just need to declare the HTTP_PROXY and HTTPS_PROXY environment variables. ...
Overview By adding the tags auto-propagation feature in Snowflake, it effectively shifted the data governance to the left at the source level and removed the burden and responsibility of identifying downstream columns which are potentially breaking the data governance strategy and exposing sensitive data due to an human error. In Snowflake, best practices for data governance is to use masking policies associated with tags. For sensitive data, masking at column level is the most common and best practice, so tags are applied at column level in Snowflake. ...
Overview With the Snowflake announcement of supporting dbt core natively in their new workspaces, it seems to have opened the door to easily adopt dbt directly in the cloud and in the data warehouse itself. This makes it easier to onboard new team members and even upskill existing team members to start using dbt directly in snowflake. This article will not go over the details to set up dbt in snowflake, but rather discuss the tradeoffs of using dbt in snowflake, dbt cloud and dbt core in a self-hosted environment. Snowflake also made another announcement with the release of dbt fusion, which is slightly different to dbt core. Lets forgot about fusion for now and carry on with core only discussion. ...