all-in-one/community-containers/local-ai/readme.md at 0521605c332502ee19f50f2ba8f3b84499cb7a2e

mirror of https://github.com/nextcloud/all-in-one.git synced 2025-01-06 13:56:45 +08:00

Simon L 0521605c33 adjust local ai docs

Signed-off-by: Simon L <szaimen@e.mail.de>

2023-10-18 16:05:59 +02:00

Local AI

This container bundles Local AI and auto-configures it for you.

After the container was started the first time, you should see a new nextcloud-aio-local-ai folder when you open the files app with the default admin user. In there you should see a models folder. Now you can download models from e.g. https://download.nextcloud.com/server/apps/stt_whisper/ or https://download.nextcloud.com/server/apps/llm/ or others that are mentioned in https://localai.io/model-compatibility/index.html#model-compatibility-table and put them into the models folder. ⚠️⚠️ Please refer to https://localai.io/features/ how each model needs to be named. Afterwards restart all containers from the AIO interface and the models should automatically get active. Additionally after doing so, you might want to enable or disable specific features for your models in the integration_openai settings: https://your-nc-domain.com/settings/admin/connected-accounts
See https://github.com/nextcloud/all-in-one/tree/main/community-containers how to add it to the AIO stack