NVIDIA

Quickly set up the NVIDIA LLM service into your NLX workspace

Integrate NVIDIA

To integrate with the NVIDIA LLM service, begin by selecting Settings from your workspace menu:

• Select the Integrations tab

• Click + Add integration

• Provide a name for the integration

• Choose NVIDIA from the Type dropdown

Got to https://build.nvidia.com/explore/discover

• Select a desired generative AI model

• Choose Get API Key (may be prompted to log in)

• Enter the following into NLX:

  • API key

  • Base URL

• When ready, click Create Integration

Optional

• Model name: Enter the preferred model (.e.g, "meta/llama-3.1-405b-instruct")

At any time, you may edit or delete your NVIDIA integration by expanding the integration name and selecting the edit or delete links.

---

Using NVIDIA

To successfully use your NVIDIA integration with conversations created in your workspace, be sure to complete the following:

• create an intent flow

• add a Generative node type to the flow invoking use of NVIDIA with a prompt > Provide your prompt (follow instructions under Side panel tab of Generative node instructions)

• create a bot build & deploy