What is Ollama?

Ollama is an open-source platform designed to run large language models (LLMs) locally on personal computers or servers. It aims to make AI technology more accessible by allowing users to download, run, and customize various AI models without relying on cloud services.

Why use Ollama?

You can save cost by using AI on your machine instead of using pay per use services from LLM providers (Open AI, Google, etc.) Job matcher talks to Ollama for job criteria analysis. When writing criteria for jobs it may take a couple of text variation before coming up with an effective criteria. You will be able to experiment with prompts without worrying about the cost.

Ollama supports a variety of models. Our criteria evaluation defaults to Llama 3 but you can configure it to use any model available in Ollama.