Run Alpaca 7B on my Macbook

Stanford released its Alpaca two weeks ago. This is an exciting development in the field of NLP and demonstrates the potential for continued advances in language models and their applications.

“ We introduce Alpaca 7B , a model fine-tuned from the LLaMA 7B model on 52K instruction-following demonstrations. On our preliminary evaluation of single-turn instruction following, Alpaca behaves qualitatively similarly to OpenAI’s text-davinci-003, while being surprisingly small and easy/cheap to reproduce (<600$). ”

Alpaca 7B is relatively small and easy to reproduce, which means it is feasible to run it on devices with limited computing resources such as a Raspberry Pi. I tried playing with it on my M1 Macbook today and the setup was quite straightforward.

npx dalai llama install 7B 3. Run

This is an excerpt — the full article continues on Medium.