Introduction to managed GenAI services
Each cloud provider implements managed services for running GenAI models, selecting FMs or LLMs, and building GenAI applications.
When you use GenAI services, you need API endpoints that receive prompts (i.e., API calls) from users (or from applications), persistent storage (storing large amounts of data), and FMs or LLMs for generating new content (new images, document summaries, chat bots, etc.).
Considerations for using data to train managed GenAI services
Before you decide to use a managed GenAI service to train GenAI models using data and gain insights, it is important to be able to ask the following questions:
- What data are you planning to use for the training (i.e., is it public data, business-related data, personally identifiable information, healthcare information, financial information, etc.)?
- What is the data classification (i.e., is it public, internal, confidential, highly confidential, etc.)?
- Is the CSP using...