vicuna = guidance.llms.transformers.Vicuna("your_path/vicuna_13B", device_map="auto")

Warning

This post is more than a year old. Information may be outdated.

microsoft/guidance: A guidance language for controlling large language models.

text

gpt4 = guidance.llms.OpenAI("gpt-4")
# vicuna = guidance.llms.transformers.Vicuna("your_path/vicuna_13B", device_map="auto")

experts = guidance('''
{{#system~}}
You are a helpful and terse assistant.
{{~/system}}

{{#user~}}
I want a response to the following question:
{{query}}
Name 3 world-class experts (past or present) who would be great at answering this?