Geek out time: try LLM and Embeddings on Nvidia NIM with Node.js

Nvidia NIM was rolled out a long time ago, but I haven’t seen it in action yet. In the past few weeks, I’ve played with the OpenAI API and local LLMs. Out of curiosity, I want to see how Nvidia NIM works. This weekend, I tried calling the Llama model and Embedding model on Nvidia’s NIM using Node.js.

Step 1: Register an Invidia NIM account

The registration for Invidia NIM is straightforward and free for developers.

Step 2: Select an LLM Model from “Models” and generate the test code

This is an excerpt — the full article continues on Medium.