19 docs tagged with "Community supported"

With the dagster-census integration you can execute a Census sync and poll until that sync completes, raising an error if it's unsuccessful.

With the dagster_cube integration you can setup Cube and Dagster to work together so that Dagster can push changes from upstream data sources to Cube using its integration API.

Delta Lake is a great storage format for Dagster workflows. With this integration, you can use the Delta Lake I/O Manager to read and write your Dagster assets.

The community-supported dagster-dingtalk package provides an integration with DingTalk.

The community-supported dagster-contrib-gcp package provides integrations with Google Cloud Platform (GCP) services. It currently includes the following integrations:

The community-supported dagster-nomad package provides an integration with HashiCorp Nomad.

Package for integrating HashiCorp Vault into Dagster so that you can securely manage tokens and passwords.

The community-supported dagster-hex package provides an integration with HashiCorp Nomad.

With this integration you can trigger Hightouch syncs and monitor them from within Dagster. Fine-tune when Hightouch syncs kick-off, visualize their dependencies, and monitor the steps in your data activation workflow.

By integrating with lakeFS, a big data scale version control system, you can leverage the versioning capabilities of lakeFS to track changes to your data. This integration allows you to have a complete lineage of your data, from the initial raw data to the transformed and processed data, making it easier to understand and reproduce data transformations.

The dagster-meltano library allows you to run Meltano using Dagster. Design and configure ingestion jobs using the popular Singer.io specification.

The community-supported dagster-modal package provides an integration with Modal.

The community-supported dagster-mssql-bcp package is a custom Dagster I/O manager for loading data into SQL Server using the bcp utility.

With this integration you can create a Open Metadata service to ingest metadata produced by the Dagster application. View the Ingestion Pipeline running from the Open Metadata Service Page.

The dagster-perian integration allows you to easily dockerize your codebase and execute it on the PERIAN platform, PERIAN's serverless GPU environment.

The community-supported dagster-ray package allows orchestrating distributed Ray compute from Dagster pipelines.

SDF can integrate seamlessly with your existing Dagster projects, providing the best-in-class transformation layer while enabling you to schedule, orchestrate, and monitor your dags in Dagster.

Connect Dagster to Secoda and see metadata related to your Dagster assets, asset groups and jobs right in Secoda. Simplify your team's access, and remove the need to switch between tools.

Use Dagster and Weights & Biases (W&B) to orchestrate your MLOps pipelines and maintain ML assets. The integration with W&B makes it easy within Dagster to: