Skip to main content

Examples

Example recipes for common Meteor use cases.

Kafka to Console​

export METEOR_KAFKA_BROKER=localhost:9092
meteor run ./kafka-console.yaml

Extracts Kafka topic metadata and prints to stdout. Uses the enrich processor to append custom fields. Learn more about dynamic recipes.

BigQuery to Kafka​

export METEOR_BIGQUERY_PROJECT_ID=my-gcp-project
meteor run ./bigquery-kafka-recipe.yaml

Extracts BigQuery metadata with column profiling enabled and streams it to a Kafka topic. The key_path config keys each message by asset URN for consistent partitioning.

Postgres to Compass​

export METEOR_PG_USER=meteor METEOR_PG_PASSWORD=secret
export METEOR_PG_HOST=localhost METEOR_PG_DATABASE=mydb
export METEOR_COMPASS_HOST=https://compass.example.com
meteor run ./postgres-compass.yaml

Extracts Postgres table metadata, adds labels via the labels processor, and uploads to Compass with field mapping.

BigQuery Multi-Sink​

export METEOR_BIGQUERY_PROJECT_ID=my-gcp-project
export METEOR_COMPASS_HOST=https://compass.example.com
export METEOR_KAFKA_BROKERS=broker1:9092,broker2:9092
meteor run ./bigquery-multi-sink.yaml

Demonstrates multiple sinks and chained processors. Extracts BigQuery metadata with column profiling and view lineage, enriches and labels assets, then sends to both Compass and Kafka simultaneously.

Tableau to File​

export METEOR_TABLEAU_HOST=https://server.tableau.com
export METEOR_TABLEAU_USERNAME=meteor_user
export METEOR_TABLEAU_PASSWORD=secret
meteor run ./tableau-file.yaml

Extracts Tableau dashboard metadata (workbooks and sheets) and saves to a local JSON file for inspection or further processing.