Xiaoxiucai LLM Machine

Specification

• 48G VRAM
  • LLM-70B tokens/minute (TPM): 30K
  • LLM-8B tokens/minute (TPM): 240K
  • Price: TBD
• 96G VRAM
  • LLM-70B tokens/minute (TPM): 60K
  • LLM-8B tokens/minute (TPM): 480K
  • Price: TBD
• 192G VRAM
  • LLM-70B tokens/minute (TPM): 120K
  • LLM-8B tokens/minute (TPM): 960K
  • Price: TBD

Xiaomianao LLM Machine

Specification

• 12G VRAM
  • LLM-70B tokens/minute (TPM): N/A
  • LLM-8B tokens/minute (TPM): 2K
  • Price: 8888(RMB)