Moda community cooperates with vLLM and FastChat to provide efficient LLM inference and deployment services
Recently, the Moda community has cooperated with vLLM and FastChat to jointly provide Chinese developers with faster and more efficient LLM inference and deployment services. Developers can use vLLM as the inference engine in FastChat to provide high-thro
2025-01-11
