At the lowest level yes. But you’re talking about millions of bits of entropy seeds being constantly gathered and spread across parameters with every new token. The industry approach to balancing stochasticity with determinism is Temperature: https://www.ibm.com/think/topics/llm-temperature
At the lowest level yes. But you’re talking about millions of bits of entropy seeds being constantly gathered and spread across parameters with every new token. The industry approach to balancing stochasticity with determinism is Temperature: https://www.ibm.com/think/topics/llm-temperature