100% Offline ChatGPT Alternative?

Published: 30 June 2023
on channel: Rob Mulla

634,771

20k

In this video I show I was able to install an open source Large Language Model (LLM) called h2oGPT on my local computer for 100% private, 100% local chat with a GPT.

Links
h2o website: https://h2o.ai/
h2oGPT UI: https://falcon.h2o.ai/
h2oGPT GM-UI : https://gpt-gm.h2o.ai/
h2oGPT github repo: https://github.com/h2oai/h2ogpt
h2o Discord:   / discord

Timeline:
00:00 100% Local Private GPT
01:01 Try h2oGPT Now
02:03 h2oGPT Github and Paper
03:11 Model Parameters
04:18 Falcon Foundational Models
06:34 Cloning the h2oGPT Repo
07:30 Installing Requirements
09:48 Running CLI
11:13 Running h2oGPT UI
12:20 Linking to Local Files
14:14 Why Open Source LLMs?

Links to my stuff:
Youtube: https://youtube.com/@robmulla?sub_con...
Discord:   / discord
Twitch:   / medallionstallion_
Twitter:   / rob_mulla
Kaggle: https://www.kaggle.com/robikscube