Add prompt caching and batch API for LLM cost reduction#1

slink merged 11 commits into

mainslink/evoforge:mainfrom

feat/prompt-caching-and-batch-apislink/evoforge:feat/prompt-caching-and-batch-apiCopy head branch name to clipboard