Does RAM speed matter for local LLMs? See when faster DDR5 boosts tokens per second and when 96GB, 128GB, or 192GB matters more.
How much RAM are you running for local LLMs right now, and have you ever benchmarked whether faster DDR5 actually improves your tokens per second?
How much RAM are you running for local LLMs right now, and have you ever benchmarked whether faster DDR5 actually improves your tokens per second?