65,000 Tokens in a LOCAL LLM 🤯 One-Click Install | Crazy New Model (High PC requirements)
Want to try out the new MPT-7B models including the 65k+ token StoryWriter, Instruct and Chat models? Well, this video includes a simple one-line install command you can run now to try it out on your PC! These models have crazy requirements, but not something people can't meet. You'll either need a lot of RAM (~32GB+) or a 3090/4090 (16GB VRAM required). The one-click installer lets you choose between CPU and GPU modes for the model.
It's a fun tech demo-type model that shows crazy things coming in the future!
MoscaicML: https://huggingface.co/mosaicml
More about MPT-7B: https://www.mosaicml.com/blog/mpt-7b
One-line install command: iex (irm mpt.tc.ht)
Timestamps:
0:00 - Intro/Explanation
0:40 - What is MPT-7
1:26 - 65,000+ tokens (Understanding pretty much a whole book!)
3:06 - Requirements
4:11 - One-line install command
7:53 - CPU only mode (for most users probably!)
8:32 - Fix crashes by lowering core count for Ooba
9:25 - Testing MPT-7b Chat
9:45 - Testing MPT-7b Storywriter (65k+ tokens!)
#MPT #AI #ChatGPT
-----------------------------
💸 Found this useful? Help me make more! Support me by becoming a member: / @troublechute
-----------------------------
💸 Direct donations via Ko-Fi: https://ko-fi.com/TCNOco
💬 Discuss the video & Suggest (Discord): https://s.tcno.co/Discord
👉 Game guides & Simple tips: / troublechutebasics
🌐 Website: https://tcno.co
📧 Need voiceovers done? Business query? Contact my business email: TroubleChute (at) tcno.co
-----------------------------
🎨 My Themes & Windows Skins: https://hub.tcno.co/faq/my-windows/
👨💻 Software I use: https://hub.tcno.co/faq/my-software/
➡️ My Setup: https://hub.tcno.co/faq/my-hardware/
🖥️ My Current Hardware (Links here are affiliate links. If you click one, I'll receive a small commission at no extra cost to you):
Intel i9-13900k - https://amzn.to/42xQuI1
GIGABYTE Z790 AORUS Master - https://amzn.to/3nHuBHx
G.Skill RipJaws 2x(2x32G) [128GB] - https://amzn.to/42cilxN
Corsair H150i 360mm AIO - https://amzn.to/42cznvP
MSI 3080Ti Gaming X Trio - https://amzn.to/3pdnLdb
Corsair 1000W RM1000i - https://amzn.to/42gOTGY
Corsair MP600 PRO XT 2TB - https://amzn.to/3NSvwzx
🎙️ My Current Mic/Recording Gear:
Shure SM7B - https://amzn.to/3nDGYo1
Audient iD14 - https://amzn.to/3pgf2XK
dbx 286s - https://amzn.to/3VNaq7O
Triton Audio FetHead - https://amzn.to/3pdjIgZ
Everything in this video is my personal opinion and experience and should not be considered professional advice. Always do your own research and ensure what you're doing is safe.