Pavan Davuluri says the rising cost of memory is why Windows 11 will use less RAM, with work on the memory manager, WinUI 3 and WebView2.
Pavan Davuluri says the rising cost of memory is why Windows 11 will use less RAM, with work on the memory manager, WinUI 3 and WebView2.
Hang on, how many surface pro owners are trying to run a local model i.e. local LLM on 8GB ram? I’ve got 32gb ram and it struggles with most larger models
Smaller models, probably.
https://tokencalculator.com/tools/llm-ram-calculator