Lightdash
Lightdash connects to Honeydew via JDBC connection, using the Trino protocol.
Metadata Sync
With Metadata Sync, Honeydew can synchronize metadata such as field definitions and descriptions to Lightdash. This allows users to see in Lightdash all attributes and metrics that are available in Honeydew.
Setting up a new dbt project for Lightdash
-
Create a new repository in your git provider, or use an existing repository
-
Create a new dbt project in the repository, or use an existing dbt project Here’s a sample empty
dbt_project.yml
file, if starting a new dbt project: -
Create a folder named
models
in the repository, in same folder asdbt_project.yml
-
Create a new empty model sql file in the
models
folder, matching the domain you’re exporting from Honeydew (for examplemydomain.sql
) -
Create a new empty model yaml file in the
models
folder, matching the domain you’re exporting from Honeydew (for examplemydomain.yml
) -
In Honeydew, go to Branch integrations -> Lightdash -> Export to Lightdash and copy the displayed content
-
Paste the content into the model yaml file (e.g.
mydomain.yml
) -
Commit and push the changes to the git repository
If no domain is selected, the default domain is called world
.
Setting up a Warehouse connection in a Lightdash project
Each Lightdash project is mapped to a Honeydew workspace and branch.
If you would like to use multiple Honeydew domains, you can create them as multiple models in the dbt project.
It is recommended to use an API Key for setting up the connection.
Create project
Create a new project and give it a name
Warehouse connection
- Set Trino as Type
- Set Host to
jdbc.honeydew.cloud
- Set Username to the API key (or a Honeydew username), and Password to the API secret
- Set DB name to
<workspace>__<branch>
value, based on the Honeydewworkspace
andbranch
you would like to connect to. Omit the branch value if connecting toprod
. For example, for workspacetpch
, branchprod
, the value would be:tpch
. And for workspacetpch
, branchdev
, it would betpch__dev
. (or to the user’s password in Honeydew). - In Advanced configuration options, set Port to
443
and SSL mode tohttps
- Click Save
If your organization uses a custom hostname for the JDBC connection, you can locate it in the Honeydew UI, under the JDBC section in Settings.
dbt connection
- Choose your git provider
- Choose the preferred dbt version
- Provide the additional details required for the git provider
- Provide the repository name - the name of the repository where the dbt project is located
- Provide the branch name which contains the version of the dbt project you would like to use
- Provide the project directory path of your dbt project in the repository
- Target name - can be left empty
- Provide the name for the schema - similar to the name of the dbt model generated by Honeydew
Test and deploy
Click Test and deploy project
Models selection
If you have multiple models in the dbt project, you will be asked to select the models to use in Lightdash. Select the model(s) you have imported from Honeydew for this project.
If you would like to use multiple Honeydew domains, you can create them as multiple models in the dbt project.
Metadata Sync
Honeydew automatically converts Honeydew metadata properties to Lightdash metadata properties.
Honeydew synchronizes the following metadata to Lightdash:
- Fields - every attribute is defined as a Lightdash dimension, and every metric as a Lightdash measure.
- Field data types.
- Field display names (to
label
Lightdash field property). When no display name is set, Honeydew creates an automatic user friendly name. - Field folders (to
groups
andgroup_details
Lightdash properties). When no folder is set, Honeydew uses the entity name as folder names. - Measure types (to
type
Lightdash measure property). Note that Honeydew can support any SQL aggregation function as a measure, hence the measure type is not always a direct mapping to Lightdash measure types. - Field hidden property (to
hidden
Lightdash field property). - Field descriptions (to
description
Lightdash field property).
In addition, the following metadata properties are also synchronized:
Lightdash-specific Metadata
Attributes and Metrics: You can add Lightdash-specific metadata, that specifies formatting and a url, to an attribute or a metric in the schema:
-
For additional information on formatting, see Lightdash documentation for dimensions and metrics formatting.
It is recommended to use https://customformats.com/ to help you building format expressions.
-
For additional documentation on urls, see the Lightdash documentation.
Using Honeydew semantic model in Lightdash
You can now run queries or create dashboards on top of the Honeydew connection, using the Lightdash user interface.
Was this page helpful?