Weights & Biases Prompt tool [1] is useful for easily logging all the interactions with LLMs (supports LangChain + Llamaindex too). It's particularly helpful for debugging since it logs all the information we need to understand and debug.
W&B makes a lot of sense for model training/tuning analytics and tracking, but seems like major overkill for a lot of other logging. Have you tried alternatives or were you using W&B already so you went with it? What is the major logging you're doing (types of info being logged) if you aren't training a model?
[1] https://wandb.ai/site/prompts