BGE-Reranker-V2-M3 Reranking Model

BGE-Reranker-V2-M3 is an AI Pod-based reranking service built into the system, typically used to perform secondary sorting of candidate results after vector retrieval, thereby improving retrieval accuracy.

Service Information

• Service address:
• Health check address:
• Container image: registry.lazycat.cloud/x/lzc-aipod-bge-rerank:a7d1e2b

Independent Deployment

1. Save the following content into a docker-compose.yml file.

services:
  bgererankerv2m3vllm:
    image: registry.lazycat.cloud/x/lzc-aipod-bge-rerank:a7d1e2b
    ports:
      - 8000:8000
    environment:
      - LANGUAGE=en_US:en
      - LANG=en_US.UTF-8
      - LC_ALL=en_US.UTF-8
      - VLLM_CONFIGURE_LOGGING=0
      - VLLM_DO_NOT_TRACK=1
      - VLLM_NO_USAGE_STATS=1
    healthcheck:
      test: ["CMD", "curl", "-f", "http://localhost:8000/health"]
      interval: 10s
      timeout: 30s
      retries: 100
      start_period: 360s

2. Run docker-compose up -d to start the service in the current directory
3. After startup, access http://127.0.0.1:8000/health to verify service health