Hello There 👋 !!!

TLDR Every corporationg have their own network securities polcies, they use network proxies to control and monitor the traffic going in and out of their network. Just assume that the proxy will be different corporation. When working with Snowflake Privatelink, you will have to get the proxies to whitelist the Snowflake private endpoints. This will only provide you access to Snowflake when interacting directly with Snowflake. When using IaC tools like Terraform, you will have to configure the proxy settings in your local environment so that Terraform can access Snowflake endpoints via the corporate proxy. This is the simple part, as you just need to declare the HTTP_PROXY and HTTPS_PROXY environment variables. ...

Overview By adding the tags auto-propagation feature in Snowflake, it effectively shifted the data governance to the left at the source level and removed the burden and responsibility of identifying downstream columns which are potentially breaking the data governance strategy and exposing sensitive data due to an human error. In Snowflake, best practices for data governance is to use masking policies associated with tags. For sensitive data, masking at column level is the most common and best practice, so tags are applied at column level in Snowflake. ...

Overview With the Snowflake announcement of supporting dbt core natively in their new workspaces, it seems to have opened the door to easily adopt dbt directly in the cloud and in the data warehouse itself. This makes it easier to onboard new team members and even upskill existing team members to start using dbt directly in snowflake. This article will not go over the details to set up dbt in snowflake, but rather discuss the tradeoffs of using dbt in snowflake, dbt cloud and dbt core in a self-hosted environment. Snowflake also made another announcement with the release of dbt fusion, which is slightly different to dbt core. Lets forgot about fusion for now and carry on with core only discussion. ...

TLDR Hugo out of box does not set up mermaid.js Multiple ways to set up mermaid.js Overview on how set up mermaid.js At this point I’ll just assume everyone knows mermaid and how it works. This post is a reference post for future me who might get asked on how I set up mermaid.js for this blog. Mermaid.js I only discovered mermaid.js when GitHub made the announcement that they were going to natively support Mermaid as part of their Markdown rendering for README or any Markdown files in GitHub and it would render as it was intended to be rendered. ...

TLDR RBAC is important for data governance Keeping the RABC simple is key to success Getting RBAC to a simple state is hard and requires alignment from all stakeholders Good implementation will make it easier manage access control Automation can help with the implementation but don’t overkill it Snowflake parent child hierarchy can simplify a lot of read only access to write access. Pair RBAC with data masking to protect sensitive data. It makes using the data platform safe for both the platform engineers and the consumers of data. What is Access Control? Access control is a way to a way to either process access or restrict access to a resource. Think of it as an automatic security gate, if a person has the key that can open the gate then they can enter through the gate and access the location. If a person doesn’t have the key then they can’t enter through the gate and access the location, in some cases security maybe informed of this incident. ...