parser: v2

auto_validation: true

time: 45

primary_tag: software-product>sap-business-technology-platform

tags: [ tutorial>beginner, topic>artificial-intelligence, topic>machine-learning, software-product>sap-business-technology-platform ]

author_name: Smita Naik

author_profile: https://github.com/I321506

1. **BTP Account**

Set up your SAP Business Technology Platform (BTP) account.

[Create a BTP Account](https://developers.sap.com/group.btp-setup.html)

2. **For SAP Developers or Employees**

Internal SAP stakeholders should refer to the following documentation:

[How to create BTP Account For Internal SAP Employee](https://me.sap.com/notes/3493139),

[SAP AI Core Internal Documentation](https://help.sap.com/docs/sap-ai-core)

3. **For External Developers, Customers, or Partners**

Follow this tutorial to set up your environment and entitlements:

[External Developer Setup Tutorial](https://developers.sap.com/tutorials/btp-cockpit-entitlements.html), [SAP AI Core External Documentation](https://help.sap.com/docs/sap-ai-core?version=CLOUD)

4. **Create BTP Instance and Service Key for SAP AI Core**

Follow the steps to create an instance and generate a service key for SAP AI Core: [Create Service Key and Instance](https://help.sap.com/docs/sap-ai-core/sap-ai-core-service-guide/create-service-key?version=CLOUD)

5. **AI Core Setup Guide**

Step-by-step guide to set up and get started with SAP AI Core:

[AI Core Setup Tutorial](https://developers.sap.com/tutorials/ai-core-setup.html)

6. An Extended SAP AI Core service plan is required, as the Generative AI Hub is not available in the Free or Standard tiers. For more details, refer to [SAP AI Core Service Plans](https://help.sap.com/docs/sap-ai-core/sap-ai-core-service-guide/service-plans?version=CLOUD)

A **web-based intelligent chatbot** capable of interacting with users via **text**, **audio**, **images**, and **video**. It returns **context-aware responses** using a **multimodal AI model**.

Multimodal assistants are the future of enterprise automation. With varied input types and conversational memory, such assistants:

- Increase productivity

- Provide rapid technical support

- Aid in education and training

- Analyze rich media content

- **SAP Generative AI Hub** for model management

- **Gemini 2.0 Flash** for multimodal LLM capabilities

- **Streamlit** for the user interface

- **Python** backend

- **Media processing** using Pillow, base64

- **Environment handling** with `python-dotenv`

- You can find the demo video of the application [here](https://video.sap.com/media/t/1_4nixy23y).

Clone the project from the repository:

git clone <your-repo-url>


In **VS Code**, open the cloned folder and install dependencies:

pip install -r requirements.txt

To deploy **Gemini 2.0 Flash**, follow the steps from the official SAP tutorial:

- **Follow Step 3 and Step 4** from this guide: [Create Deployment for a Generative AI Model](https://help.sap.com/docs/sap-ai-core/sap-ai-core-service-guide/create-deployment-for-generative-ai-model-in-sap-ai-core)

- To get the latest **model name** and **version information**, refer to this SAP Note: [3437766 - Generative AI Hub Models](https://me.sap.com/notes/3437766)

Once deployed, note down the following:

- **Model Name** (e.g., `gemini-2.0-flash`)

- **Deployment ID**

- Open **main.py** and navigate to the configuration section. Replace the placeholders for model name and deployment ID with your actual values:


In the project root, create a `.env` file:

In VS Code, open the terminal and run the below command:

streamlit run main.py



- Choose a short video file in formats: **MP4 or MOV**

- After uploading, you can ask questions such as:

- *"Please provide a concise summary of the events taking place in this video"*



- Use an audio file in formats: WAV or MP3, or record live.

- Analyze transcription or tone

- You can ask questions like:

- *"What was said?"*

- *"Detect the language."*


Upload an image in formats like JPG or PNG for analysis.

- Drag & drop or select an image file

- Ask questions like:

- *"Describe what is happening in this image and indentify any notabl branding or sponsorships visible."*



The assistant delivers accurate, context-aware responses across media types. It’s an enterprise-ready, scalable solution leveraging SAP’s AI infrastructure.

| Scenario | Value Proposition |

|----------------------|---------------------------------------------------------------------|

| 🎓 Education | AI tutors analyzing diagrams and lecture recordings |

| 🛠️ Tech Support | Use screenshots, logs, and voice memos for intelligent resolution |

| 📈 Business Insights | Analyze media submissions for trends and decisions |

| 🎤 Voice Assistants | Voice queries in workflows, meeting minutes, etc. |

- You can find the demo video of the application [here](https://video.sap.com/media/t/1_4nixy23y).

> Smarter user interfaces

> Scalable support systems

> Rich media understanding