我需要在Bitbucket的所有项目中提取所有repos的列表。是否有相同的REST API?我找不到一个。
我有内部部署和云Bitbucket。
对于Bitbucket Cloud
您可以使用其REST API在您的服务器上访问和执行查询。
具体来说,您可以使用this documentation page, provided by Atlassian,来学习如何列出您的存储库。
对于Bitbucket Server
编辑:截至收到this tweet from Dan Bennett,我已经了解到Bitbucket Server有一个API /插件系统,可以满足您的需求。对于文档:See here.
编辑2:找到this reference列出可作为解决方案的个人存储库。
AFAIK没有为您提供解决方案,除非您为自己构建了一个与您的Bitbucket Server实例交互的API。
Atlassian Documentation does indicate要列出所有当前配置的存储库,你可以做git remote -v
。但是我对此持怀疑态度,因为通常不会使用git remote -v
;我认为Atlassian的文档更有可能不清楚,而不是Atlassian在这个功能中构建Bitbucket Server。
克隆给定存储网址的所有项目和存储库
#!/usr/bin/python
#
# @author Jason LeMonier
#
# Clone ALL Projects & Repositories for a given stash url
#
# Loop through all projects: [P1, P2, ...]
# P1 > for each project make a directory with the key "P1"
# Then clone every repository inside of directory P1
# Backup a directory, create P2, ...
#
# Added ACTION_FLAG bit so the same logic can run fetch --all on every repository and/or clone.
import sys
import os
import stashy
ACTION_FLAG = 1 # Bit: +1=Clone, +2=fetch --all
url = os.environ["STASH_URL"] # "https://mystash.com/stash"
user = os.environ["STASH_USER"] # joedoe"
pwd = os.environ["STASH_PWD"] # Yay123
stash = stashy.connect(url, user, pwd)
def mkdir(xdir):
if not os.path.exists(xdir):
os.makedirs(xdir)
def run_cmd(cmd):
print ("Directory cwd: %s "%(os.getcwd() ))
print ("Running Command: \n %s " %(cmd))
os.system(cmd)
start_dir = os.getcwd()
for project in stash.projects:
pk = project_key = project["key"]
mkdir(pk)
os.chdir(pk)
for repo in stash.projects[project_key].repos.list():
for url in repo["links"]["clone"]:
href = url["href"]
repo_dir = href.split("/")[-1].split(".")[0]
if (url["name"] == "http"):
print (" url.href: %s"% href) # https://[email protected]/stash/scm/app/ae.git
print ("Directory cwd: %s Project: %s"%(os.getcwd(), pk))
if ACTION_FLAG & 1 > 0:
if not os.path.exists(repo_dir):
run_cmd("git clone %s" % url["href"])
else:
print ("Directory: %s/%s exists already. Skipping clone. "%(os.getcwd(), repo_dir))
if ACTION_FLAG & 2 > 0:
# chdir into directory "ae" based on url of this repo, fetch, chdir back
cur_dir = os.getcwd()
os.chdir(repo_dir)
run_cmd("git fetch --all ")
os.chdir(cur_dir)
break
os.chdir(start_dir) # avoiding ".." in case of incorrect git directories
这个ruby脚本不是最好的代码,这是有道理的,因为我不是最好的编码器。但它很清楚,经过测试,并且有效。
该脚本过滤Bitbucket API调用的输出,以创建Bitbucket服务器上所有存储库的完整报告。报告按项目安排,包括总计和小计,每个回购的链接,以及回购是公开的还是个人的。我可以简化它以供一般使用,但它非常有用。
没有命令行参数。跑吧。
#!/usr/bin/ruby
#
# @author Bill Cernansky
#
# List and count all repos on a Bitbucket server, arranged by project, to STDOUT.
#
require 'json'
bbserver = 'http(s)://server.domain.com'
bbuser = 'username'
bbpassword = 'password'
bbmaxrepos = 2000 # Increase if you have more than 2000 repos
reposRaw = JSON.parse(`curl -s -u '#{bbuser}':'#{bbpassword}' -X GET #{bbserver}/rest/api/1.0/repos?limit=#{bbmaxrepos}`)
projects = {}
repoCount = reposRaw['values'].count
reposRaw['values'].each do |r|
projID = r['project']['key']
if projects[projID].nil?
projects[projID] = {}
projects[projID]['name'] = r['project']['name']
projects[projID]['repos'] = {}
end
repoName = r['name']
projects[projID]['repos'][repoName] = r['links']['clone'][0]['href']
end
privateProjCount = projects.keys.grep(/^\~/).count
publicProjCount = projects.keys.count - privateProjCount
reportText = ''
privateRepoCount = 0
projects.keys.sort.each do |p|
# Personal project slugs always start with tilde
isPrivate = p[0] == '~'
projRepoCount = projects[p]['repos'].keys.count
privateRepoCount += projRepoCount if isPrivate
reportText += "\nProject: #{p} : #{projects[p]['name']}\n #{projRepoCount} #{isPrivate ? 'PERSONAL' : 'Public'} repositories\n"
projects[p]['repos'].keys.each do |r|
reportText += sprintf(" %-30s : %s\n", r, projects[p]['repos'][r])
end
end
puts "BITBUCKET REPO REPORT\n\n"
puts sprintf(" Total Projects: %5d Public: %5d Personal: %5d", projects.keys.count, publicProjCount, privateProjCount)
puts sprintf(" Total Repos: %5d Public: %5d Personal: %5d", repoCount, repoCount - privateRepoCount, privateRepoCount)
puts reportText
我解决这个问题的方法是获取html页面并给它一个荒谬的限制。在python中的那个:
cmd = "curl -s -k --user " + username + " https://URL/projects/<KEY_PROJECT_NAME>/?limit\=10000"
然后我用BeautifulSoup解析它
make_list = str((subprocess.check_output(cmd, shell=True)).rstrip().decode("utf-8"))
html = make_list
parsed_html = BeautifulSoup(html,'html.parser')
list1 = []
for a in parsed_html.find_all("a", href=re.compile("/<projects>/<KEY_PROJECT_NAME>/repos/")):
list1.append(a.string)
print(list1)
使用它确保你改变,这应该是你的目标bitbucket项目。我正在做的就是解析一个html文件。
我最终不得不自己做一个Bitbucket的本地安装,它似乎没有上面讨论的REST API可访问,所以我想出了一个简短的脚本来将其从网页中删除。这种解决方法的优势在于您无需安装任何内容,除了登录Bitbucket服务器之外,您无需担心依赖关系,证书或登录。如果您对脚本进行了urlencode并使用javascript:
作为前缀,您也可以将其设置为书签。
要使用它:
F12
或ctrl-shift-i
。JSON.stringify(Array.from(document.querySelectorAll('[data-repository-id]')).map(aTag => {
const href = aTag.getAttribute('href');
let projName = href.match(/\/projects\/(.+)\/repos/)[1].toLowerCase();
let repoName = href.match(/\/repos\/(.+)\/browse/)[1];
repoName = repoName.replace(' ', '-');
const templ = `https://${location.host}/scm/${projName}/${repoName}.git`;
return {
href,
name: aTag.innerText,
clone: templ
}
}));
结果是一个JSON字符串,其中包含一个包含repo的URL,名称和克隆URL的数组。
[{
"href": "/projects/FOO/repos/some-repo-here/browse",
"name": "some-repo-here",
"clone": "https://mybitbucket.company.com/scm/foo/some-repo-here.git"
}]