在开始之前,请确保安装了llama_index
%pip install llama-index-llms-perplexity
!pip install llama-index
截至2023年11月14日,LLaMa索引中的Perplexity LLM类支持以下模型:
模型 | 上下文长度 | 模型类型 |
---|---|---|
codellama-34b-instruct | 16384 | 聊天完成 |
llama-2-13b-chat | 4096 | 聊天完成 |
llama-2-70b-chat | 4096 | 聊天完成 |
mistral-7b-instruct | 4096 [1] | 聊天完成 |
openhermes-2-mistral-7b | 4096 [1] | 聊天完成 |
openhermes-2.5-mistral-7b | 4096 [1] | 聊天完成 |
replit-code-v1.5-3b | 4096 | 文本完成 |
pplx-7b-chat-alpha | 4096 | 聊天完成 |
pplx-70b-chat-alpha | 4096 | 聊天完成 |
[1] mistral-7b-instruct和openhermes-2-mistral-7b的上下文长度将增加到32k个标记(请参阅困惑度路线图)。
您可以在这里找到最新支持的模型 - https://docs.perplexity.ai/docs/model-cards
速率限制在这里找到 - https://docs.perplexity.ai/docs/rate-limits
from llama_index.llms.perplexity import Perplexity
pplx_api_key = "your-perplexity-api-key"
llm = Perplexity(
api_key=pplx_api_key, model="mistral-7b-instruct", temperature=0.5
)
from llama_index.core.llms import ChatMessage
messages_dict = [
{"role": "system", "content": "Be precise and concise."},
{"role": "user", "content": "Tell me 5 sentences about Perplexity."},
]
messages = [ChatMessage(**msg) for msg in messages_dict]
这是一个简单的聊天机器人示例,用于演示如何使用Python创建一个基本的聊天机器人。
response = llm.chat(messages)
print(response)
assistant: 1. Perplexity is the state of being puzzled or confused. 2. It is a measure of how difficult it is to understand something. 3. Perplexity can be caused by a lack of information or a mismatch between the information provided and what is being understood. 4. It can also be caused by the complexity of a problem or the way it is presented. 5. Perplexity can be reduced through further information, clarification, or simplification.
response = await llm.achat(messages)
print(response)
assistant: 1. Perplexity is a measure of how difficult it is to understand or solve a problem or concept. 2. It is often used in fields such as cryptography, linguistics, and artificial intelligence. 3. A high degree of perplexity indicates that a problem or concept is complex and difficult to understand. 4. Perplexity can be calculated using various mathematical formulas, such as the entropy formula. 5. Perplexity is an important concept in many areas of study, as it helps researchers to better understand and solve complex problems.
Stream Chat 是一个强大的实时聊天解决方案,它提供了一整套工具和功能,用于构建具有实时消息传递功能的应用程序。Stream Chat 提供了易于集成的 API 和丰富的 SDK,支持多种平台和编程语言。它还提供了用户身份验证、消息存储、通知和丰富的消息格式化功能,使开发人员能够快速构建出色的聊天体验。
resp = llm.stream_chat(messages)
for r in resp:
print(r.delta, end="")
1. Perplexity refers to the state of being confused or bewildered. 2. It can be caused by a lack of understanding or a mismatch between one's expectations and reality. 3. Perplexity can occur in various areas of life, such as personal relationships, work, or decision-making processes. 4. It can lead to feelings of frustration or anxiety, and can be difficult to resolve. 5. However, perplexity can also be a source of inspiration or creativity, as it can challenge one's assumptions and assumptions.
resp = await llm.astream_chat(messages)
async for delta in resp:
print(delta.delta, end="")
1. Perplexity refers to the state of being puzzled or confused. 2. It is often associated with a lack of understanding or difficulty in comprehending something. 3. Perplexity can be caused by a variety of factors, including complexity, ambiguity, or lack of information. 4. It can manifest in different forms, such as confusion, uncertainty, or disorientation. 5. Perplexity can be overcome through problem-solving, clarification, or seeking additional information.