Skip to content

pipeshub-ai/pipeshub-ai

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

1,946 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

PipesHub Logo

Workplace AI Platform

pipeshub-ai%2Fpipeshub-ai | Trendshift

⭐ Star the repo! It helps the platform reach more developers and grow the community.

Docs Β Β  Discord

GitHub Repo stars Β  GitHub forks Β  Docker Prod Pulls

GitHub issues Β  GitHub pull requests Β  Contributors Β  Last commit

License: Apache-2.0 Twitter Follow Follow on LinkedIn

Table of Contents

About PipesHub

PipesHub is a fully extensible and explainable workplace AI platform for enterprise search and workflow automation. In most companies, important work data is spread across multiple apps like Google Workspace, Microsoft 365, Slack, Jira, Confluence, and more. PipesHub AI helps you quickly find the right information using natural language searchβ€”just like Google. It can answer questions, provide insights, and more. The platform not only delivers the most relevant results but also shows where the information came from, with proper citations, using Knowledge Graphs and Page Ranking. Beyond search, our platform allows enterprises to create custom apps and AI agents using a No-Code interface.

High Level Architecture Diagram

PipesHub System Architecture

Spotlight Features

Your Workplace, Our AI.

PipesHub Workplace AI
Watch Video

Unmatched Value of PipesHub

  • Choose Any Model, Your Way – Bring your preferred deep learning models for both indexing and inference with total flexibility.
  • Real-Time or Scheduled Indexing – Index data as it flows or schedule it to run exactly when you need.
  • Access-Driven Visibility – Source-level permissions ensure every document is shown only to those who are authorized.
  • Built-In Data Security – Sensitive information stays secure, always..
  • Deploy Anywhere – Fully supports both on-premise and cloud-based deployments.
  • Knowledge Graph Backbone – All data is seamlessly structured into a powerful knowledge graph.
  • Enterprise-Grade Connectors – Scalable, reliable, and built for secure access across your organization.
  • Modular & Scalable Architecture – Every service is loosely coupled to scale independently and adapt to your needs.

Connectors

Google Drive Gmail Google Calendar Google Docs Google Sheets Google Slides Google Forms Google Meet OneDrive SharePoint Online Outlook Calendar Microsoft Teams OneNote Jira Confluence Slack Notion Dropbox Linear GitHub GitLab Zendesk Airtable Bookstack S3 Azure Blob Box

File Formats Supported

  • PDF(including scanned PDFs)
  • Docx/Doc
  • XLSX/XLS
  • PPTX/PPT
  • CSV
  • Markdown
  • HTML
  • Text
  • Google docs, slides, sheets
  • Images
  • Audio
  • Video

Tech Stack

Frontend

  • React - Component-based UI library
  • TypeScript - Strongly typed JavaScript superset
  • Material UI - Prebuilt React UI components
  • Zod – Schema validation and parsing
  • React Hook Form – Flexible form state management

Backend

  • FastAPI - High-performance Python web framework
  • LangChain - Framework for LLM pipelines
  • LangGraph – State graph for LLM workflows
  • Qdrant - Vector similarity search engine
  • Neo4j/ArangoDB - Graph database
  • Kafka - Distributed event streaming platform
  • Redis - In-memory caching, messaging and key-value configuration store
  • Celery - Distributed task queue system
  • Docling - Document parsing and extraction toolkit
  • PyMuPDF - PDF processing library
  • OCRmyPDF - OCR text layer for PDFs
  • pandas - Data analysis and manipulation
  • etcd3 - Distributed key-value configuration store

πŸš€ Deployment Guide

PipesHub (the Workplace AI Platform) can be run locally or deployed on the cloud using Docker Compose. Note: If you are deploying PipesHub on a cloud server, make sure you are using an HTTPS endpoint. PipesHub enforces stricter security checks, and browsers will block certain requests when the application is served over HTTP. You can use a reverse proxy like Cloudflare, Nginx, or Traefik to terminate SSL/TLS and provide a valid HTTPS certificate. If you see a white screen after deploying PipesHub while accessing it over HTTP, this is likely the cause. The frontend will refuse to load due to stricter security checks.


πŸ“¦ Production Deployment

# Clone the repository
git clone https://github.com/pipeshub-ai/pipeshub-ai.git

# πŸ“ Navigate to the deployment folder
cd pipeshub-ai/deployment/docker-compose

# Set Environment Variables
> πŸ‘‰ Set Environment Variables for secrets, passwords, and the public URLs of the **Frontend** and **Connector** services
> _(Required for webhook notifications and real-time updates)_
> Refer to env.template

# πŸš€ Start the production deployment
docker compose -f docker-compose.prod.yml -p pipeshub-ai up -d

# πŸ›‘ To stop the services
docker compose -f docker-compose.prod.yml -p pipeshub-ai down

πŸ“¦ Developer Deployment Build

# Clone the repository
git clone https://github.com/pipeshub-ai/pipeshub-ai.git

# πŸ“ Navigate to the deployment folder
cd pipeshub-ai/deployment/docker-compose

# Set Optional Environment Variables
> πŸ‘‰ Set Environment Variables for secrets, passwords, and the public URLs of the **Frontend** and **Connector** services
> _(Required for webhook notifications and real-time updates)_
> Refer to env.template

# πŸš€ Start the development deployment with build
docker compose -f docker-compose.dev.yml -p pipeshub-ai up --build -d

# πŸ›‘ To stop the services
docker compose -f docker-compose.dev.yml -p pipeshub-ai down

MCP Server

Use PipesHub with any MCP-compatible client to bring your enterprise context into AI workflows. Check the README for setup and usage.

Repository: pipeshub-ai/mcp-server

SDKs

PipesHub provides developer SDKs for Python, TypeScript, and Go to help you integrate quickly. Check the respective SDK repository README for setup and usage details.

Name Description Link
Python SDK Python SDK for PipesHub pipeshub-ai/pipeshub-sdk-python
TypeScript SDK TypeScript SDK for PipesHub pipeshub-ai/pipeshub-sdk-typescript
Go SDK Go SDK for PipesHub pipeshub-ai/pipeshub-sdk-go

Need an SDK in another language? Reach out to us at developer@pipeshub.com

RoadMap

  • Code Search
  • Workplace AI Agents
  • MCP
  • APIs and SDKs
  • Personalized Search
  • Highly available and scalable Kubernetes deployment
  • PageRank

πŸ‘₯ Contributing

Want to join our community of developers? Please check out our Contributing Guide for more details on how to set up the development environment, our coding standards, and the contribution workflow.


Star ⭐ us on GitHub!

Star us on GitHub

Star History Chart

About

PipesHub is a fully extensible and explainable workplace AI platform for enterprise search and workflow automation

Topics

Resources

License

Code of conduct

Contributing

Security policy

Stars

Watchers

Forks

Packages

 
 
 

Contributors