"Failed to get response from /generate endpoint of chain-server. Check if the fastapi server in chain-server is up. Refer to chain-server logs for details." #232

Activity

1. MarkoBrie commented on Nov 6, 2024

   

   MarkoBrie

   on Nov 6, 2024

   More actions

   I get the same message for the GenerativeAIExamples/RAG/examples/basic_rag/llamaindex.
   Message: "Failed to get response from /generate endpoint of chain-server. Check if the fastapi server in chain-server is up. Refer to chain-server logs for details."
2. MarkoBrie commented on Nov 6, 2024

   

   MarkoBrie

   on Nov 6, 2024

   More actions

   I get the same message for the GenerativeAIExamples/RAG/examples/basic_rag/llamaindex. Message: "Failed to get response from /generate endpoint of chain-server. Check if the fastapi server in chain-server is up. Refer to chain-server logs for details."

   Somehow the export of the NVIDIA_API_KEY was ignored. I repeated the export and the error was not shown anymore.
3. thalapandi commented on Nov 6, 2024

   

   thalapandi

   on Nov 6, 2024

   More actions

   https://python.langchain.com/docs/integrations/chat/nvidia_ai_endpoints/
4. lbliii commented on Nov 9, 2024

   

   lbliii

   on Nov 9, 2024

   More actions

   There seems to be a missing dependency issue in the RAG/src/chain-server/tracing.py file at the following location:

   from RAG.tools.observability.langchain import opentelemetry_callback as langchain_otel_cb
   from RAG.tools.observability.llamaindex import opentelemetry_callback as llama_index_otel_cb
   

   When I inspect the exited chain-server container, I see the following error:

   from RAG.tools.observability.langchain import opentelemetry_callback as langchain_otel_cb
   2024-11-09 11:38:58 ModuleNotFoundError: No module named 'RAG.tools.observability'
   
5. buildvoc-agent

   added a commit that references this issue on Mar 21, 2026

   feat: add local gpu allocation (NVIDIA#232)

   ...

   9f0181a