Ollama
With Ollama you can run popular LLMs like Llama, Gemma, Qwen and dozens of others locally for free!
Last updated
With Ollama you can run popular LLMs like Llama, Gemma, Qwen and dozens of others locally for free!
Last updated
Install the Ollama application locally on your machine: use Download at ollama.com button to download the Ollama app. Make sure the app is running after installation.
Install at least one Ollama model, either manually from the , or using the Terminal command ollama run <model_name>. For example, to install the llama 3.2 model, use the command ollama run llama3.2.
Test & Configure AI Dev Kit
Once you add any additional model, please click the Refresh installed models button to update the list of available models in the dropdown.
Test the connection using the Test Connection button.