Public Alpha

Introduction to LLMs

Understand AI and LLMs.

What is an LLM?

LLM stands for Large Language Model. MUI Chat generates code using a few LLMs:

Which provide robust programming performance and web development. OpenAI's ChatGPT is another popular LLM that you may have heard of or used yourself.

Without getting too detailed, LLMs work as a very smart autocomplete. It doesn't 'know' information, but based on all of the training information it has been fed, it's able to generate 'new' thoughts based on patterns that it detected during training. If you want to check out in more detail how it works, we recommend watching this video.

In the case of MUI Chat, the LLM helps you generate code that aligns with your prompt, based on similar applications with similar specifications that it has been trained on.

Prompts

A prompt is a message you send to the AI. How you write your prompts is key to getting good results. Refer to Prompt effectively for more guidance.

Context

Context is all the information about the project that's available to the AI: your prompts, previous responses, and the existing code. The context window is the amount of text that a large language model (LLM) can process at once.

MUI Chat provides a large context window, but you still can't rely on the AI remembering your whole conversation. There's a tradeoff here, as larger context windows consume tokens faster, which increases costs.

A way to preserve context while keeping the context window small is to get the AI to summarize the conversation so far, then reset the context window.

Credits system

The credits system for MUI Chat works pretty simply. For each successful reply, we charge the user 1 credit. So if you have 30 credits, it means you can get 30 responses from the AI.