Skip to content
forked from orchest/orchest

Build data pipelines, the easy way ๐Ÿ› ๏ธ

License

Notifications You must be signed in to change notification settings

luke0623/orchest

ย 
ย 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

Build data pipelines, the easy way ๐Ÿ™Œ

No frameworks. No YAML. Just write your data processing code directly in Python, R or Julia.

orchest-0.3.0-demo

๐Ÿ’ก Watch the full narrated video to learn more about building data pipelines in Orchest.

NOTE: Orchest is in beta.

Features

  • Visually construct pipelines through our user-friendly UI
  • Code in Notebooks and scripts (quickstart)
  • Run any subset of a pipelines directly or periodically (jobs)
  • Easily define your dependencies to run on any machine (environments)
  • Spin up services whose lifetime spans across the entire pipeline run (services)
  • Version your projects using git (projects)

When to use Orchest? Read it in the docs.

๐Ÿ‘‰ Get started with our quickstart tutorial, check out pipelines made by your fellow users, or have a look at our video tutorials explaining some of Orchest's core concepts.

Installation

Want to skip the installation and jump right in? Then try out our managed service by clicking:

Open in Orchest

For instructions on how to deploy a self-hosted version, check out our installation docs.

License

The software in this repository is licensed as follows:

  • All content residing under the "orchest-sdk/" and "orchest-cli/" directories of this repository are licensed under the "Apache-2.0" license as defined in "orchest-sdk/LICENSE" and "orchest-cli/LICENSE" respectively.
  • Content outside of the above mentioned directory is available under the "AGPL-3.0" license.

Slack Community

Join our Slack to chat about Orchest, ask questions, and share tips.

Join us on Slack

Contributing

Contributions are more than welcome! Please see our contributor guides for more details.

You could also submit your pipeline to the curated list of examples. Help other users try out your pipeline with one click by adding the following script in the README.md of your repository (NOTE: you need to replace your-repo-url with your repo URL).

[![Open in Orchest](https://github.com/orchest/orchest-examples/raw/main/imgs/open_in_orchest.svg)](https://cloud.orchest.io/?import_url=your-repo-url)

An example badge to import our quickstart repo in Orchest:

Open in Orchest

Contributors

About

Build data pipelines, the easy way ๐Ÿ› ๏ธ

Resources

License

Security policy

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Python 45.8%
  • TypeScript 44.0%
  • Go 4.9%
  • Shell 1.7%
  • SCSS 1.5%
  • Dockerfile 0.8%
  • Other 1.3%