torchx0.7.0
torchx0.7.0
Published
TorchX SDK and Components
pip install torchx
Package Downloads
Authors
Project URLs
Requires Python
>=3.7
Dependencies
- pyre-extensions
- docstring-parser
>=0.8.1
- importlib-metadata
- pyyaml
- docker
- filelock
- fsspec
>=2023.10.0
- urllib3
<1.27,>=1.21.1
- tabulate
- boto3
; extra == "aws-batch"
- aiobotocore
==2.12.1; extra == "dev"
- ax-platform
[mysql]==0.2.3; extra == "dev"
- boto3
==1.34.51; extra == "dev"
- captum
>=0.4.0; extra == "dev"
- docker
; extra == "dev"
- kubernetes
==25.3.0; extra == "dev"
- flake8
==3.9.0; extra == "dev"
- fsspec
==2024.3.1; extra == "dev"
- s3fs
==2024.3.1; extra == "dev"
- google-api-core
; extra == "dev"
- google-cloud-batch
==0.17.14; extra == "dev"
- google-cloud-logging
==3.10.0; extra == "dev"
- google-cloud-runtimeconfig
==0.34.0; extra == "dev"
- hydra-core
; extra == "dev"
- ipython
; extra == "dev"
- kfp
==1.8.22; extra == "dev"
- mlflow-skinny
; extra == "dev"
- moto
~=5.0.8; extra == "dev"
- pyre-extensions
; extra == "dev"
- pyre-check
; extra == "dev"
- pytest
; extra == "dev"
- pytest-cov
; extra == "dev"
- pytorch-lightning
==2.3.1; extra == "dev"
- tensorboard
==2.14.0; extra == "dev"
- sagemaker
>=2.149.0; extra == "dev"
- torch-model-archiver
>=0.4.2; extra == "dev"
- torch
==2.2.1; extra == "dev"
- torchmetrics
==0.10.3; extra == "dev"
- torchserve
>=0.10.0; extra == "dev"
- torchtext
==0.17.1; extra == "dev"
- torchvision
==0.17.1; extra == "dev"
- ts
==0.5.1; extra == "dev"
- ray
[default]; extra == "dev"
- lintrunner
; extra == "dev"
- lintrunner-adapters
; extra == "dev"
- grpcio
==1.62.1; extra == "dev"
- grpcio-status
==1.48.1; extra == "dev"
- googleapis-common-protos
==1.63.0; extra == "dev"
- google-api-core
==2.18.0; extra == "dev"
- protobuf
==3.20.3; extra == "dev"
- google-cloud-batch
>=0.5.0; extra == "gcp-batch"
- google-cloud-logging
>=3.0.0; extra == "gcp-batch"
- google-cloud-runtimeconfig
>=0.33.2; extra == "gcp-batch"
- kfp
==1.6.2; extra == "kfp"
- kubernetes
>=11; extra == "kubernetes"
- ray
>=1.12.1; extra == "ray"
TorchX
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
TorchX currently supports:
- Kubernetes (EKS, GKE, AKS, etc)
- Slurm
- AWS Batch
- Docker
- Local
- Ray (prototype)
- GCP Batch (prototype)
Need a scheduler not listed? Let us know!
Quickstart
See the quickstart guide.
Documentation
Requirements
torchx:
Certain schedulers may require scheduler specific requirements. See installation for info.
Installation
Stable
# install torchx sdk and CLI -- minimum dependencies
pip install torchx
# install torchx sdk and CLI -- all dependencies
pip install "torchx[dev]"
# install torchx kubeflow pipelines (kfp) support
pip install "torchx[kfp]"
# install torchx Kubernetes / Volcano support
pip install "torchx[kubernetes]"
# install torchx Ray support
pip install "torchx[ray]"
# install torchx GCP Batch support
pip install "torchx[gcp_batch]"
Nightly
# install torchx sdk and CLI
pip install torchx-nightly[dev]
Source
# install torchx sdk and CLI from source
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx
# install extra dependencies
$ pip install -e git+https://github.com/pytorch/torchx.git#egg=torchx[dev]
Docker
TorchX provides a docker container for using as as part of a TorchX role.
See: https://github.com/pytorch/torchx/pkgs/container/torchx
Contributing
We welcome PRs! See the CONTRIBUTING file.
License
TorchX is BSD licensed, as found in the LICENSE file.