Skip to main content

GitHub

本笔记展示了如何加载给定仓库在GitHub上的问题和拉取请求(PR)。还展示了如何加载给定仓库在GitHub上的文件。我们将以LangChain Python仓库为例。

设置访问令牌

要访问GitHub API,您需要一个个人访问令牌 - 您可以在这里设置您的令牌:https://github.com/settings/tokens?type=beta。您可以将此令牌设置为环境变量``GITHUB_PERSONAL_ACCESS_TOKEN``,它将自动被提取,或者您可以在初始化时直接作为``access_token``命名参数传入。

# If you haven't set your access token as an environment variable, pass it in here.
from getpass import getpass

ACCESS_TOKEN = getpass()

加载问题和PR

<!--IMPORTS:[{"imported": "GitHubIssuesLoader", "source": "langchain_community.document_loaders", "docs": "https://python.langchain.com/api_reference/community/document_loaders/langchain_community.document_loaders.github.GitHubIssuesLoader.html", "title": "GitHub"}]-->
from langchain_community.document_loaders import GitHubIssuesLoader
loader = GitHubIssuesLoader(
repo="langchain-ai/langchain",
access_token=ACCESS_TOKEN, # delete/comment out this argument if you've set the access token as an env var.
creator="UmerHA",
)

让我们加载由 "UmerHA" 创建的所有问题和PR。

这是您可以使用的所有过滤器的列表:

  • 包括PR
  • 里程碑
  • 状态
  • 指派人
  • 创建者
  • 提及
  • 标签
  • 排序
  • 方向

有关更多信息,请参见 https://docs.github.com/en/rest/issues/issues?apiVersion=2022-11-28#list-repository-issues。

docs = loader.load()
print(docs[0].page_content)
print(docs[0].metadata)

仅加载问题

默认情况下,GitHub API 将拉取请求视为问题。要仅获取“纯”问题(即没有拉取请求),请使用 include_prs=False

loader = GitHubIssuesLoader(
repo="langchain-ai/langchain",
access_token=ACCESS_TOKEN, # delete/comment out this argument if you've set the access token as an env var.
creator="UmerHA",
include_prs=False,
)
docs = loader.load()
print(docs[0].page_content)
print(docs[0].metadata)

加载 Github 文件内容

以下代码加载 rpeo langchain-ai/langchain 中的所有 markdown 文件

<!--IMPORTS:[{"imported": "GithubFileLoader", "source": "langchain_community.document_loaders", "docs": "https://python.langchain.com/api_reference/community/document_loaders/langchain_community.document_loaders.github.GithubFileLoader.html", "title": "GitHub"}]-->
from langchain_community.document_loaders import GithubFileLoader
loader = GithubFileLoader(
repo="langchain-ai/langchain", # the repo name
branch="master", # the branch name
access_token=ACCESS_TOKEN,
github_api_url="https://api.github.com",
file_filter=lambda file_path: file_path.endswith(
".md"
), # load all markdowns files.
)
documents = loader.load()

文档的示例输出:

document.metadata: 
{
"path": "README.md",
"sha": "82f1c4ea88ecf8d2dfsfx06a700e84be4",
"source": "https://github.com/langchain-ai/langchain/blob/master/README.md"
}
document.content:
mock content

相关


Was this page helpful?


You can also leave detailed feedback on GitHub.

扫我,入群扫我,找书