LLMs

Overview

This section contains code examples of how to perform an array of actions around large language models (LLMs) in h2oGPTe.

Examples

• List LLMs and their compatible vision model names
• List available LLMs
• View performance metrics for configured and unconfigured LLMs
• View the total usage cost of all LLMs used in the past 24 hours
• View usage cost metrics for used LLMs in the past 24 hours
• List vision capable LLMs
• View usage metrics for each LLM used