Skip to content

using deepseek problem #1305

Open
Open

Description

@wuhq7

Referred to the example in this place(https://github.com/Canner/WrenAI/blob/main/wren-ai-service/docs/config_examples/config.deepseek.yaml), and modified the pipeline configuration of 0.15.3, please help to see where there is a problem that needs to be modified

config.txt

env.txt

wrenai-wren-ai-service-1.txt

Activity

  1. jos666 commented on Feb 24, 2025

    @jos666
    1. embedder 配置要修改 deepseek 没有embedder 模型(本地部署 nomic-embed-text 模型)
    #运行ollama server
    OLLAMA_HOST="0.0.0.0" #设置这个环境变量
    ollama pull nomic-embed-text
    ollama serve
    type: embedder
    provider: litellm_embedder
    models:
    - model: openai/nomic-embed-text  # put your embedding model name here, if it is not openai embedding model, should be <provider>/<model_name>
      api_base: http://192.168.1.88:11434/v1  # change this according to your embedding model    
      #api_key_name: EMBEDDER_OLLAMA_API_KEY
      api_key_name: OPENAI_API_KEY
      timeout: 600
    1. type: document_store 的 embedding_model_dim 修改为 768
    2. deepseek 官方的api限流经常503体验不好
  2. wuhq7 commented on Feb 27, 2025

    @wuhq7
    Author
    1. embedder 配置要修改 deepseek 没有embedder 模型(本地部署 nomic-embed-text 模型)

    #运行ollama server
    OLLAMA_HOST="0.0.0.0" #设置这个环境变量
    ollama pull nomic-embed-text
    ollama serve
    type: embedder
    provider: litellm_embedder
    models:

    • model: openai/nomic-embed-text # put your embedding model name here, if it is not openai embedding model, should be /<model_name>
      api_base: http://192.168.1.88:11434/v1 # change this according to your embedding model
      #api_key_name: EMBEDDER_OLLAMA_API_KEY
      api_key_name: OPENAI_API_KEY
      timeout: 600
    1. type: document_store 的 embedding_model_dim 修改为 768
    2. deepseek 官方的api限流经常503体验不好

    哥能不能加个微信DDD-527 请教一下。 @jos666

  3. zhenglu696 commented on Mar 27, 2025

    @zhenglu696

    Referred to the example in this place(https://github.com/Canner/WrenAI/blob/main/wren-ai-service/docs/config_examples/config.deepseek.yaml), and modified the pipeline configuration of 0.15.3, please help to see where there is a problem that needs to be modified

    config.txt

    env.txt

    wrenai-wren-ai-service-1.txt

    @wuhq7 你这个问题解决了吗?

  4. zhenglu696 commented on Mar 27, 2025

    @zhenglu696
    Image

    利用deepseek模型,我这边也报错

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions