How to run your favorite local AI model easily on Linux with this easy app

I have been using AI as one of my Go-Two Tools for research for some time. Although there are many options that can be accessed through a web browser (such as opera area, first AI service that I ever used), I prefer desktop tools because I can install and use local LLM – so all my questions are private. With a desktop tool, I can easily switch between local LLMs such as lama, deepsek R1, Mystic Instruction, Oroke, GPT 4all Falcon, and more.

Till now, my default Linux was AI Gui Musti, but I have got a new app that is good. That app is Gpt4allAvailable for Linux, MacoS and Windows.

Also: My two favorite AI apps on Linux – and how I use them to do more

GPT4all can be used for standard questions, as a personal writing assistant, to write code, and more. It is also for a great UI that is easy to use and will fit straight with your desktop look and feel.

One aspect of GPT4all that I appreciate is the ability to choose a compute device for lesson production. For example, my System76 Thelio has AMD Radeon RX 7600 GPU. GPT4all suggests that GPU allows me to use either the vulcan: AMD Radeon RX 7600 (RADV Navi33) or Vulkan: AMD Radeon RX 7600 (REDV RAPHAAL_Mendocino).

I can also choose my default model, change the suggestion mode (to generate follow-up questions), configure the number of CPU threads, enable system tray apps, and more. I can enable a local API server to reach through GPT4all http: // localhost: 4891The negative side of using it in server mode is that it consumes more system resources.

Let’s install GPT4all on Linux, so I can show you what is.

Installing GPT4all on Ubuntu-based distribution

what you’ll need: Currently, the only supported Linux distribution is based on Ubuntu, so you will need a running example of Ubuntu-based distribution. I will display it at the pop! _OS Linux.

Chmod U+X GPT4all- Installer-Linux.run

,

Note that you do not need to use Sudo for installation. If you try to install GPT4all with Sudo, it will error. When the installation wizard opens, click through the steps to complete the installation.

Also: How do I feed my files to a local AI for better, more relevant reactions

Without installation, one should be fulfilled without a bottleneck.

Using GPT4all

When you open the GPT4all for the first time, you will need to either use anonymous use anonymous and get out in anonymous sharing or chat. I would advise you to get out. Once you do this, you will find yourself on the main GPT4all window, where you will need to install a local model.

To install your first model, click on the model and then click on the Add model. In the resulting window, scroll down and find out the model you want, such as Lama 3.2 3B instructions. When you find it, click download to start the process. Remember, these models can be quite large (the smallest lama 3.2 3B instructions at 1.79 GB).

Once the model is downloaded and installed, you will find it listed in the model section.

Also: How to run Deepsek AI locally to protect your privacy – 2 easy ways

Click on the chat icon in the left sidebar. If you have installed only one model, it will be listed in the top center. If you have installed many models, select you want to use from that drop-down.

Type your query in the “Send a message” field and hit the entre to your keyboard. GPT4all will be busy working to respond to your query. If you have enabled follow -up suggestions, they will be listed below the answer. I like follow-up suggestions because they help me dive into some seriously practical (and sometimes fun) rabbit hole. On my System76 TheLio, I focused on the additional calculation overhead required by the suggested follow -up follow -up, so it is worth enabled.

And that, my friends, all have to install GPT4all on Linux – and the basics to use this accessories.

Want more stories about AI? Sign up for innovationOur weekly newspapers.