Q25Fundamentals of GenAI
A company is using a pre-trained large language model (LLM) to build a chatbot for product recommendations. The company needs the LLM outputs to be short and written in a specific language. Which solution will align the LLM response quality with the company's expectations?
← → navigate · a answer
Community votes
Discussion · 12
A 16
B not correct - The size of LLM may not affect the size of the output.
C not correct - Temperature controls the creativity of the output, not size of the output.
D not correct - Top-K controls number of next possible tokens, not size of the output.
A is correct - In the prompt itself we can control various attributes of the output like size, language etc.
A 3
Adjusting the prompt will only help
A 3
A is correct
A 2
if yo want to tune the output or the quality of the output , then you should touch the hyperparameters such as Top K( for randomness ), Top P, Max Tokens etc
But when you want to tune or modify the response format , then we should touch the prompt only , such as output formatting in the llm prompt , mentioning the specific language
Hope this helps
A 2
Adjusting the prompt allows you to guide the model to produce responses that are more aligned with your desired output. By modifying the prompt, you can specify the length and language requirements more clearly. For example, you could ask the model to "Provide a short product recommendation in [specific language]." This is the most direct way to control the behavior of the LLM and ensure it meets the company’s needs.
A 1
B not correct - The size of LLM may not affect the size of the output.
C not correct - Temperature controls the creativity of the output, not size of the output.
D not correct - Top-K controls number of next possible tokens, not size of the output.
A is correct - In the prompt itself we can control various attributes of the output like size, language etc.
A 1
Adjust the prompt
A 1
A: adjust the prompt is a powerful way to ensure the llm mmets the company's needs the concise and language speciific outputs.
A 1
A) Adjust the prompt. is correct – You can directly instruct the model in the prompt to produce concise responses in the desired language, ensuring output meets the company’s requirements.
B) Choose an LLM of a different size. not correct – Changing the model size may impact performance or understanding, but it won’t guarantee the output is shorter or in a specific language.
C) Increase the temperature. not correct – Temperature affects randomness and creativity in responses, not the length or format.
D) Increase the Top K value. not correct – The model can choose from more options, which makes output more varied and creative, but it doesn’t control the length of the answer or the language
A 1
A: Adjust the prompt.
Explanation:
The behavior of a large language model (LLM) can be significantly influenced by the prompt it receives. To make the outputs short and written in a specific language, you can adjust the prompt to explicitly instruct the model to produce concise responses and specify the desired language. For example:
"Provide a brief recommendation in Spanish."
"Give a short response in French."
This is the most direct way to align the output with the company’s expectations without requiring modifications to the model or its parameters.
A 1
Adjusting the prompt
A 1
A is the correct answer.