Dec 31, 2023 · I am about to embark on experimenting with " RAG on Windows using TensorRT-LLM and LlamaIndex ". Since I have an RTX 4070, it is written in ...

r/LocalLLaMA: Subreddit to discuss about Llama, the large language model created by Meta AI.

Command-R, 35B open... · New · Request failed · Rising

Feb 14, 2024 · Tried it on RTX 4070. Unfortunately, if I add more than 2 PDFs to the dataset, it starts to use more than 12GB of VRAM, spilling into the RAM ...

May 14, 2023 · I have installed llama13b and am trying to use it as if it's a simple chat bot (ie like I would chat GPT). However most of the time I am not ...

Jul 24, 2023 · My question is: Is it possible to download a huggingface repo as a zip / tarball via http instead of git? Side note: It seems that when you ...

Dec 12, 2023 · So, I created a new token in HuggingFace and changed the user/pass in "Environment Variables" in Windows. And it still refuses to download. The ...

Aug 11, 2023 · 166K subscribers in the LocalLLaMA community. Subreddit to discuss about Llama, the large language model created by Meta AI.

Mar 3, 2023 · Note that this PR is not made by a member of Facebook/Meta staff. I have downloaded parts of the torrent and it does appear to be lots of ...