Add micro batching and enpoints for v1 list_models and get_model#41

baixiac wants to merge 1 commit intomainCogStack/CogStack-ModelServe:mainfrom

llm-gen2CogStack/CogStack-ModelServe:llm-gen2Copy head branch name to clipboard