We often use the same LLMs in many prompts. So, when LLMs are updated, we have to update them in each and every prompt we use, which can be time-consuming as our list of prompts grows.

To make this easier, I suggest managing the list of LLMs we chose to work with as a global parameter, separate from the prompts. This list would be available for each prompt. We could keep the ‘Group name’ and ‘Provider routing’ at this level.

At the prompt level, we could keep only the advanced LLM parameters (temperature, etc.) which do not change when the LLMs are updated, and which we need to duplicate to all the LLMs we use with a specific prompt (see attached document).

This way, when an LLM is updated or a new LLM becomes available, we would only have to update the list of LLMs instead of all our prompts.