Walkthrough: Using local AI models with Ollama

mahesh-panchal commented

2026-08-20 07:22:09 +00:00

(Migrated from github.com)

Proposed Topic

Ollama is an easy way to run open models, including running LLM models locally.

Why This Topic?

LLM use is increasing, but frontier models are not suitable for sensitive data.
Using locally hosted models, allows users to benefit from LLM use while still keeping data private.

Potential Presenter

I'd like to present this myself
I'm just suggesting the topic

Additional Context

https://ollama.com/

## Proposed Topic Ollama is an easy way to run open models, including running LLM models locally. ## Why This Topic? LLM use is increasing, but frontier models are not suitable for sensitive data. Using locally hosted models, allows users to benefit from LLM use while still keeping data private. ## Suggested Content - Installing Ollama - Selecting models - Running Ollama itself - Using Ollama through an API endpoint. - Alternatives to Ollama ## Potential Presenter  - [x] I'd like to present this myself - [ ] I'm just suggesting the topic ## Additional Context  https://ollama.com/

👍 1

machlabd commented

2026-08-21 09:08:05 +00:00

(Migrated from github.com)

I would be curious to hear about your experience with this, and how well they work in an IDE like Positron.

mahesh-panchal commented

2026-08-21 09:54:29 +00:00

(Migrated from github.com)

I would be curious to hear about your experience with this, and how well they work in an IDE like Positron.

I've used them through the Zoo Code VScode extension, and Claude Code cli, in VSCodium. I've not opened Positron in a long time, and I haven't tried to connect it to their AI connection tool.

> I would be curious to hear about your experience with this, and how well they work in an IDE like Positron. I've used them through the Zoo Code VScode extension, and Claude Code cli, in VSCodium. I've not opened Positron in a long time, and I haven't tried to connect it to their AI connection tool.

👍 1

mahesh-panchal commented

2026-08-21 11:06:41 +00:00

(Migrated from github.com)

Also, in what way were you think when you said my experience? I'm mostly coding workflows and doing documentation but what it appears a lot of posit people are doing is they're making use of the image analysis capability to look for outliers and such on their plots. That I definitely haven't tried.
https://opensource.posit.co/blog/2026-08-14_ai-newsletter/

Also, in what way were you think when you said my experience? I'm mostly coding workflows and doing documentation but what it appears a lot of posit people are doing is they're making use of the image analysis capability to look for outliers and such on their plots. That I definitely haven't tried. https://opensource.posit.co/blog/2026-08-14_ai-newsletter/

machlabd commented

2026-08-21 11:12:47 +00:00

(Migrated from github.com)

I was thinking along the lines of how well the local LLM works and helpful it is when it comes to using it to suggest and implement code as well as in its "chat" capacities. But I would be curious to hear about any applications and uses you have had with it.

👍 1

machlabd commented

2026-08-21 11:14:26 +00:00

(Migrated from github.com)