Think of it as a very useful prefix match. If all of your threads start with the same system prompt, you will reap benefits from prompt caching.