mercurial-scm/hg: contrib/automation/hgautomation/cli.py annotate

annotate contrib/automation/hgautomation/cli.py @ 44771:802ee93c205d stable

automation: support building Python 3 Inno installers The core packaging code now supports building Python 3 installers using PyOxidizer. Let's teach the automation code to invoke it so that we produce both Python 2 and Python 3 based exe installers. When publishing the artifacts, the Python 3 versions are preferred over the Python 2 versions given their higher weight (10 versus 9). This may be a controversial change. But I think making Python 3 the default is warranted, as it is the future. The Python 2 installers are still fully supported and can be installed should issues with Python 3 arise. Differential Revision: https://phab.mercurial-scm.org/D8483

author	Gregory Szorc <gregory.szorc@gmail.com>
date	Fri, 24 Apr 2020 12:11:08 -0700
parents	9d441f820c8b
children	5e788dc7fb5d

rev	line source
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	1 # cli.py - Command line interface for automation
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	2 #
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	3 # Copyright 2019 Gregory Szorc <gregory.szorc@gmail.com>
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	4 #
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	5 # This software may be used and distributed according to the terms of the
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	6 # GNU General Public License version 2 or any later version.
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	7
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	8 # no-check-code because Python 3 native.
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	9
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	10 import argparse
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	11 import concurrent.futures as futures
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	12 import os
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	13 import pathlib
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	14 import time
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	15
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	16 from . import (
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	17 aws,
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	18 HGAutomation,
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	19 linux,
43057 c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	20 try_server,
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	21 windows,
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	22 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	23
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	24
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	25 SOURCE_ROOT = pathlib.Path(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	26 os.path.abspath(__file__)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	27 ).parent.parent.parent.parent
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	28 DIST_PATH = SOURCE_ROOT / 'dist'
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	29
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	30
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	31 def bootstrap_linux_dev(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	32 hga: HGAutomation, aws_region, distros=None, parallel=False
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	33 ):
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	34 c = hga.aws_connection(aws_region)
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	35
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	36 if distros:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	37 distros = distros.split(',')
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	38 else:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	39 distros = sorted(linux.DISTROS)
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	40
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	41 # TODO There is a wonky interaction involving KeyboardInterrupt whereby
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	42 # the context manager that is supposed to terminate the temporary EC2
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	43 # instance doesn't run. Until we fix this, make parallel building opt-in
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	44 # so we don't orphan instances.
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	45 if parallel:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	46 fs = []
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	47
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	48 with futures.ThreadPoolExecutor(len(distros)) as e:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	49 for distro in distros:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	50 fs.append(e.submit(aws.ensure_linux_dev_ami, c, distro=distro))
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	51
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	52 for f in fs:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	53 f.result()
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	54 else:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	55 for distro in distros:
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	56 aws.ensure_linux_dev_ami(c, distro=distro)
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	57
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	58
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	59 def bootstrap_windows_dev(hga: HGAutomation, aws_region, base_image_name):
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	60 c = hga.aws_connection(aws_region)
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	61 image = aws.ensure_windows_dev_ami(c, base_image_name=base_image_name)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	62 print('Windows development AMI available as %s' % image.id)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	63
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	64
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	65 def build_inno(
44771 802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	66 hga: HGAutomation,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	67 aws_region,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	68 python_version,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	69 arch,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	70 revision,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	71 version,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	72 base_image_name,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	73 ):
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	74 c = hga.aws_connection(aws_region)
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	75 image = aws.ensure_windows_dev_ami(c, base_image_name=base_image_name)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	76 DIST_PATH.mkdir(exist_ok=True)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	77
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	78 with aws.temporary_windows_dev_instances(c, image, 't3.medium') as insts:
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	79 instance = insts[0]
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	80
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	81 windows.synchronize_hg(SOURCE_ROOT, revision, instance)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	82
44771 802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	83 for py_version in python_version:
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	84 for a in arch:
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	85 windows.build_inno_installer(
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	86 instance.winrm_client,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	87 py_version,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	88 a,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	89 DIST_PATH,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	90 version=version,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	91 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	92
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	93
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	94 def build_wix(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	95 hga: HGAutomation, aws_region, arch, revision, version, base_image_name
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	96 ):
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	97 c = hga.aws_connection(aws_region)
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	98 image = aws.ensure_windows_dev_ami(c, base_image_name=base_image_name)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	99 DIST_PATH.mkdir(exist_ok=True)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	100
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	101 with aws.temporary_windows_dev_instances(c, image, 't3.medium') as insts:
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	102 instance = insts[0]
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	103
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	104 windows.synchronize_hg(SOURCE_ROOT, revision, instance)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	105
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	106 for a in arch:
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	107 windows.build_wix_installer(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	108 instance.winrm_client, a, DIST_PATH, version=version
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	109 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	110
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	111
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	112 def build_windows_wheel(
44768 9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	113 hga: HGAutomation,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	114 aws_region,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	115 python_version,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	116 arch,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	117 revision,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	118 base_image_name,
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	119 ):
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	120 c = hga.aws_connection(aws_region)
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	121 image = aws.ensure_windows_dev_ami(c, base_image_name=base_image_name)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	122 DIST_PATH.mkdir(exist_ok=True)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	123
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	124 with aws.temporary_windows_dev_instances(c, image, 't3.medium') as insts:
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	125 instance = insts[0]
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	126
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	127 windows.synchronize_hg(SOURCE_ROOT, revision, instance)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	128
44768 9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	129 for py_version in python_version:
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	130 for a in arch:
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	131 windows.build_wheel(
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	132 instance.winrm_client, py_version, a, DIST_PATH
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	133 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	134
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	135
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	136 def build_all_windows_packages(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	137 hga: HGAutomation, aws_region, revision, version, base_image_name
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	138 ):
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	139 c = hga.aws_connection(aws_region)
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	140 image = aws.ensure_windows_dev_ami(c, base_image_name=base_image_name)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	141 DIST_PATH.mkdir(exist_ok=True)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	142
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	143 with aws.temporary_windows_dev_instances(c, image, 't3.medium') as insts:
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	144 instance = insts[0]
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	145
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	146 winrm_client = instance.winrm_client
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	147
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	148 windows.synchronize_hg(SOURCE_ROOT, revision, instance)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	149
44768 9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	150 for py_version in ("2.7", "3.7", "3.8"):
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	151 for arch in ("x86", "x64"):
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	152 windows.purge_hg(winrm_client)
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	153 windows.build_wheel(
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	154 winrm_client,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	155 python_version=py_version,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	156 arch=arch,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	157 dest_path=DIST_PATH,
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	158 )
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	159
44771 802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	160 for py_version in (2, 3):
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	161 for arch in ('x86', 'x64'):
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	162 windows.purge_hg(winrm_client)
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	163 windows.build_inno_installer(
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	164 winrm_client, py_version, arch, DIST_PATH, version=version
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	165 )
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	166
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	167 for arch in ('x86', 'x64'):
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	168 windows.purge_hg(winrm_client)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	169 windows.build_wix_installer(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	170 winrm_client, arch, DIST_PATH, version=version
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	171 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	172
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	173
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	174 def terminate_ec2_instances(hga: HGAutomation, aws_region):
42277 dd6a9723ae2b automation: don't create resources when deleting things Gregory Szorc <gregory.szorc@gmail.com> parents: 42024 diff changeset	175 c = hga.aws_connection(aws_region, ensure_ec2_state=False)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	176 aws.terminate_ec2_instances(c.ec2resource)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	177
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	178
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	179 def purge_ec2_resources(hga: HGAutomation, aws_region):
42277 dd6a9723ae2b automation: don't create resources when deleting things Gregory Szorc <gregory.szorc@gmail.com> parents: 42024 diff changeset	180 c = hga.aws_connection(aws_region, ensure_ec2_state=False)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	181 aws.remove_resources(c)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	182
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	183
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	184 def run_tests_linux(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	185 hga: HGAutomation,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	186 aws_region,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	187 instance_type,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	188 python_version,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	189 test_flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	190 distro,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	191 filesystem,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	192 ):
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	193 c = hga.aws_connection(aws_region)
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	194 image = aws.ensure_linux_dev_ami(c, distro=distro)
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	195
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	196 t_start = time.time()
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	197
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	198 ensure_extra_volume = filesystem not in ('default', 'tmpfs')
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	199
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	200 with aws.temporary_linux_dev_instances(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	201 c, image, instance_type, ensure_extra_volume=ensure_extra_volume
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	202 ) as insts:
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	203
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	204 instance = insts[0]
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	205
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	206 linux.prepare_exec_environment(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	207 instance.ssh_client, filesystem=filesystem
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	208 )
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	209 linux.synchronize_hg(SOURCE_ROOT, instance, '.')
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	210 t_prepared = time.time()
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	211 linux.run_tests(instance.ssh_client, python_version, test_flags)
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	212 t_done = time.time()
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	213
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	214 t_setup = t_prepared - t_start
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	215 t_all = t_done - t_start
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	216
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	217 print(
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	218 'total time: %.1fs; setup: %.1fs; tests: %.1fs; setup overhead: %.1f%%'
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	219 % (t_all, t_setup, t_done - t_prepared, t_setup / t_all * 100.0)
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	220 )
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	221
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	222
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	223 def run_tests_windows(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	224 hga: HGAutomation,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	225 aws_region,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	226 instance_type,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	227 python_version,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	228 arch,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	229 test_flags,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	230 base_image_name,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	231 ):
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	232 c = hga.aws_connection(aws_region)
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	233 image = aws.ensure_windows_dev_ami(c, base_image_name=base_image_name)
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	234
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	235 with aws.temporary_windows_dev_instances(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	236 c, image, instance_type, disable_antivirus=True
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	237 ) as insts:
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	238 instance = insts[0]
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	239
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	240 windows.synchronize_hg(SOURCE_ROOT, '.', instance)
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	241 windows.run_tests(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	242 instance.winrm_client, python_version, arch, test_flags
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	243 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	244
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	245
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	246 def publish_windows_artifacts(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	247 hg: HGAutomation,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	248 aws_region,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	249 version: str,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	250 pypi: bool,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	251 mercurial_scm_org: bool,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	252 ssh_username: str,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	253 ):
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	254 windows.publish_artifacts(
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	255 DIST_PATH,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	256 version,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	257 pypi=pypi,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	258 mercurial_scm_org=mercurial_scm_org,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	259 ssh_username=ssh_username,
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	260 )
42907 92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	261
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	262
43057 c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	263 def run_try(hga: HGAutomation, aws_region: str, rev: str):
c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	264 c = hga.aws_connection(aws_region, ensure_ec2_state=False)
c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	265 try_server.trigger_try(c, rev=rev)
c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	266
c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	267
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	268 def get_parser():
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	269 parser = argparse.ArgumentParser()
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	270
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	271 parser.add_argument(
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	272 '--state-path',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	273 default='~/.hgautomation',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	274 help='Path for local state files',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	275 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	276 parser.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	277 '--aws-region', help='AWS region to use', default='us-west-2',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	278 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	279
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	280 subparsers = parser.add_subparsers()
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	281
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	282 sp = subparsers.add_parser(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	283 'bootstrap-linux-dev', help='Bootstrap Linux development environments',
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	284 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	285 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	286 '--distros', help='Comma delimited list of distros to bootstrap',
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	287 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	288 sp.add_argument(
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	289 '--parallel',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	290 action='store_true',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	291 help='Generate AMIs in parallel (not CTRL-c safe)',
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	292 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	293 sp.set_defaults(func=bootstrap_linux_dev)
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	294
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	295 sp = subparsers.add_parser(
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	296 'bootstrap-windows-dev',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	297 help='Bootstrap the Windows development environment',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	298 )
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	299 sp.add_argument(
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	300 '--base-image-name',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	301 help='AMI name of base image',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	302 default=aws.WINDOWS_BASE_IMAGE_NAME,
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	303 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	304 sp.set_defaults(func=bootstrap_windows_dev)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	305
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	306 sp = subparsers.add_parser(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	307 'build-all-windows-packages', help='Build all Windows packages',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	308 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	309 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	310 '--revision', help='Mercurial revision to build', default='.',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	311 )
42283 d137a3d5ad41 automation: add --version argument to build-all-windows-packages Gregory Szorc <gregory.szorc@gmail.com> parents: 42277 diff changeset	312 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	313 '--version', help='Mercurial version string to use',
42283 d137a3d5ad41 automation: add --version argument to build-all-windows-packages Gregory Szorc <gregory.szorc@gmail.com> parents: 42277 diff changeset	314 )
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	315 sp.add_argument(
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	316 '--base-image-name',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	317 help='AMI name of base image',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	318 default=aws.WINDOWS_BASE_IMAGE_NAME,
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	319 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	320 sp.set_defaults(func=build_all_windows_packages)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	321
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	322 sp = subparsers.add_parser(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	323 'build-inno', help='Build Inno Setup installer(s)',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	324 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	325 sp.add_argument(
44771 802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	326 '--python-version',
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	327 help='Which version of Python to target',
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	328 choices={2, 3},
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	329 type=int,
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	330 nargs='*',
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	331 default=[3],
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	332 )
802ee93c205d automation: support building Python 3 Inno installers Gregory Szorc <gregory.szorc@gmail.com> parents: 44768 diff changeset	333 sp.add_argument(
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	334 '--arch',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	335 help='Architecture to build for',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	336 choices={'x86', 'x64'},
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	337 nargs='*',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	338 default=['x64'],
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	339 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	340 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	341 '--revision', help='Mercurial revision to build', default='.',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	342 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	343 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	344 '--version', help='Mercurial version string to use in installer',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	345 )
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	346 sp.add_argument(
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	347 '--base-image-name',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	348 help='AMI name of base image',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	349 default=aws.WINDOWS_BASE_IMAGE_NAME,
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	350 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	351 sp.set_defaults(func=build_inno)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	352
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	353 sp = subparsers.add_parser(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	354 'build-windows-wheel', help='Build Windows wheel(s)',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	355 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	356 sp.add_argument(
44768 9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	357 '--python-version',
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	358 help='Python version to build for',
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	359 choices={'2.7', '3.7', '3.8'},
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	360 nargs='*',
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	361 default=['3.8'],
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	362 )
9d441f820c8b automation: support building Windows wheels for Python 3.7 and 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 43076 diff changeset	363 sp.add_argument(
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	364 '--arch',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	365 help='Architecture to build for',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	366 choices={'x86', 'x64'},
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	367 nargs='*',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	368 default=['x64'],
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	369 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	370 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	371 '--revision', help='Mercurial revision to build', default='.',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	372 )
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	373 sp.add_argument(
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	374 '--base-image-name',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	375 help='AMI name of base image',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	376 default=aws.WINDOWS_BASE_IMAGE_NAME,
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	377 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	378 sp.set_defaults(func=build_windows_wheel)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	379
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	380 sp = subparsers.add_parser('build-wix', help='Build WiX installer(s)')
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	381 sp.add_argument(
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	382 '--arch',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	383 help='Architecture to build for',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	384 choices={'x86', 'x64'},
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	385 nargs='*',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	386 default=['x64'],
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	387 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	388 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	389 '--revision', help='Mercurial revision to build', default='.',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	390 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	391 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	392 '--version', help='Mercurial version string to use in installer',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	393 )
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	394 sp.add_argument(
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	395 '--base-image-name',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	396 help='AMI name of base image',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	397 default=aws.WINDOWS_BASE_IMAGE_NAME,
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	398 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	399 sp.set_defaults(func=build_wix)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	400
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	401 sp = subparsers.add_parser(
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	402 'terminate-ec2-instances',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	403 help='Terminate all active EC2 instances managed by us',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	404 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	405 sp.set_defaults(func=terminate_ec2_instances)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	406
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	407 sp = subparsers.add_parser(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	408 'purge-ec2-resources', help='Purge all EC2 resources managed by us',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	409 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	410 sp.set_defaults(func=purge_ec2_resources)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	411
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	412 sp = subparsers.add_parser('run-tests-linux', help='Run tests on Linux',)
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	413 sp.add_argument(
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	414 '--distro',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	415 help='Linux distribution to run tests on',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	416 choices=linux.DISTROS,
43018 d1d919f679f7 automation: support and use Debian Buster by default Gregory Szorc <gregory.szorc@gmail.com> parents: 42907 diff changeset	417 default='debian10',
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	418 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	419 sp.add_argument(
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	420 '--filesystem',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	421 help='Filesystem type to use',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	422 choices={'btrfs', 'default', 'ext3', 'ext4', 'jfs', 'tmpfs', 'xfs'},
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	423 default='default',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	424 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	425 sp.add_argument(
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	426 '--instance-type',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	427 help='EC2 instance type to use',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	428 default='c5.9xlarge',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	429 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	430 sp.add_argument(
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	431 '--python-version',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	432 help='Python version to use',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	433 choices={
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	434 'system2',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	435 'system3',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	436 '2.7',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	437 '3.5',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	438 '3.6',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	439 '3.7',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	440 '3.8',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	441 'pypy',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	442 'pypy3.5',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	443 'pypy3.6',
2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	444 },
42285 65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	445 default='system2',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	446 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	447 sp.add_argument(
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	448 'test_flags',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	449 help='Extra command line flags to pass to run-tests.py',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	450 nargs='*',
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	451 )
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	452 sp.set_defaults(func=run_tests_linux)
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	453
65b3ef162b39 automation: initial support for running Linux tests Gregory Szorc <gregory.szorc@gmail.com> parents: 42283 diff changeset	454 sp = subparsers.add_parser(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	455 'run-tests-windows', help='Run tests on Windows',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	456 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	457 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	458 '--instance-type', help='EC2 instance type to use', default='t3.medium',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	459 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	460 sp.add_argument(
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	461 '--python-version',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	462 help='Python version to use',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	463 choices={'2.7', '3.5', '3.6', '3.7', '3.8'},
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	464 default='2.7',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	465 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	466 sp.add_argument(
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	467 '--arch',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	468 help='Architecture to test',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	469 choices={'x86', 'x64'},
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	470 default='x64',
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	471 )
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	472 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	473 '--test-flags', help='Extra command line flags to pass to run-tests.py',
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	474 )
42648 d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	475 sp.add_argument(
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	476 '--base-image-name',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	477 help='AMI name of base image',
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	478 default=aws.WINDOWS_BASE_IMAGE_NAME,
d80edcb0b30c automation: make Windows base image name configurable Gregory Szorc <gregory.szorc@gmail.com> parents: 42285 diff changeset	479 )
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	480 sp.set_defaults(func=run_tests_windows)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	481
42907 92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	482 sp = subparsers.add_parser(
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	483 'publish-windows-artifacts',
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	484 help='Publish built Windows artifacts (wheels, installers, etc)',
42907 92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	485 )
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	486 sp.add_argument(
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	487 '--no-pypi',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	488 dest='pypi',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	489 action='store_false',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	490 default=True,
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	491 help='Skip uploading to PyPI',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	492 )
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	493 sp.add_argument(
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	494 '--no-mercurial-scm-org',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	495 dest='mercurial_scm_org',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	496 action='store_false',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	497 default=True,
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	498 help='Skip uploading to www.mercurial-scm.org',
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	499 )
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	500 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	501 '--ssh-username', help='SSH username for mercurial-scm.org',
42907 92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	502 )
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	503 sp.add_argument(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	504 'version', help='Mercurial version string to locate local packages',
42907 92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	505 )
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	506 sp.set_defaults(func=publish_windows_artifacts)
92593d72e10b automation: implement "publish-windows-artifacts" command Gregory Szorc <gregory.szorc@gmail.com> parents: 42648 diff changeset	507
43057 c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	508 sp = subparsers.add_parser(
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	509 'try', help='Run CI automation against a custom changeset'
43057 c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	510 )
43076 2372284d9457 formatting: blacken the codebase Augie Fackler <augie@google.com> parents: 43057 diff changeset	511 sp.add_argument('-r', '--rev', default='.', help='Revision to run CI on')
43057 c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	512 sp.set_defaults(func=run_try)
c5c502bd1f70 automation: add a command to submit to a Try server Gregory Szorc <gregory.szorc@gmail.com> parents: 43055 diff changeset	513
42024 b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	514 return parser
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	515
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	516
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	517 def main():
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	518 parser = get_parser()
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	519 args = parser.parse_args()
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	520
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	521 local_state_path = pathlib.Path(os.path.expanduser(args.state_path))
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	522 automation = HGAutomation(local_state_path)
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	523
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	524 if not hasattr(args, 'func'):
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	525 parser.print_help()
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	526 return
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	527
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	528 kwargs = dict(vars(args))
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	529 del kwargs['func']
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	530 del kwargs['state_path']
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	531
b05a3e28cf24 automation: perform tasks on remote machines Gregory Szorc <gregory.szorc@gmail.com> parents: diff changeset	532 args.func(automation, **kwargs)

Mercurial > public > mercurial-scm > hg

annotate contrib/automation/hgautomation/cli.py @ 44771:802ee93c205d stable