Skip to content

Commit 3d50f51

Browse files
hitesh-parmarhitesh-parmar
authored
Merge branch 'sap-tutorials:master' into master
2 parents c89d1cd + 64b3e67 commit 3d50f51

102 files changed

Lines changed: 712 additions & 140 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎tutorials/ai-core-custom-slm/ai-core-custom-slm.md‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -7,8 +7,8 @@ primary_tag: software-product>sap-ai-core
77
author_name: Dhrubajyoti Paul
88
author_profile: https://github.com/dhrubpaul
99
---
10-
# Using small language models on SAP AI Core
11-
<!-- description --> In this tutorial we are going to learn on how to deploy a custom LLM on AI core using ollama for the example we would be taking Gemma as a model from hugging face and deploy it on SAP AI core.
10+
# Using Small Language models on SAP AI Core VIA ollama
11+
<!-- description --> In this tutorial we are going to learn on how to deploy a SLM on AI core using ollama for the example we would be taking llava-phi3 as a model from hugging face and deploy it on SAP AI core
1212

1313
## You will learn
1414
- How to Deploy ollama on AI core
@@ -25,7 +25,7 @@ In this tutorial we are deploying ollama an open-source project that serves as a
2525

2626
![image](img/solution-architecture.png)
2727

28-
We can pick any model from the above model hubs and connect it to AI core for the example we are going to deploy ollama on AI core and enable Gemma and inference the same.
28+
We can pick any model from the above model hubs and connect it to AI core for the example we are going to deploy ollama on AI core and enable llava-phi3 and inference the same.
2929

3030
### Adding workflow file to github
3131
Workflows for SAP AI Core are created using YAML or JSON files that are compatible with the SAP AI Core schema. Let’s start with adding a Argo Workflow file to manage: `ollama`.
@@ -284,7 +284,7 @@ Once the deployment is running, you can access the LLM’s using ollama.
284284

285285
### Pulling llava-phi3 and Performing Inference
286286

287-
Now we need to import llava-phi3 to our ollama pod before we can inference the model so here we would be using SAP AI API to call pull model call in Ollama.
287+
Now we need to import llava-phi3 to our ollama pod before we can infrence the model so here we would be using SAP AI API to call pull model call in Ollama.
288288

289289
[OPTION BEGIN [Postman]]
290290

‎tutorials/ai-core-custom-slm/img/Picture1.png‎

68.1 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture10.png‎

40 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture11.png‎

110 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture12.png‎

159 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture13.png‎

127 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture14.png‎

178 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture2.png‎

47.4 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture3.png‎

48 KB
Loading

‎tutorials/ai-core-custom-slm/img/Picture4.png‎

44.1 KB
Loading

0 commit comments

Comments
 (0)