If you need to keep windows around, you can also do what I do for my VMs. Download Win11 Enterprise IoT LTSC from massgrave.dev. Doesn’t have Bing search in the search bar, just local, no Co-pilot, no bullshit.

I’d prefer not having to use it at all, but some software just doesn’t play nice with wine yet.

LLMs are stateless. The model itself stays the same. Doesn’t mean they’re not saving the data elsewhere, but the LLM does not retain interactions.