databricks-connect17.3.0
databricks-connect17.3.0
Published
Databricks Connect Client
pip install databricks-connect
Package Downloads
Authors
Requires Python
==3.12.*
Dependencies
- databricks-sdk
>=0.46.0 - googleapis-common-protos
>=1.65.0 - grpcio-status
>=1.67.0 - grpcio
>=1.67.0 - numpy
>=1.15 - packaging
>=23.2 - pandas
>=1.0.5 - py4j
==0.10.9.9 - pyarrow
>=10.0.0 - setuptools
>=68.0.0 - six
- zstandard
>=0.23.0 - googleapis-common-protos
>=1.65.0; extra == "connect" - grpcio-status
>=1.67.0; extra == "connect" - grpcio
>=1.67.0; extra == "connect" - numpy
>=1.21; extra == "connect" - pandas
>=1.0.5; extra == "connect" - pyarrow
>=10.0.0; extra == "connect" - zstandard
>=0.23.0; extra == "connect" - numpy
>=1.21; extra == "ml" - numpy
>=1.21; extra == "mllib" - numpy
>=1.21; extra == "pandas-on-spark" - pandas
>=1.0.5; extra == "pandas-on-spark" - pyarrow
>=10.0.0; extra == "pandas-on-spark" - googleapis-common-protos
>=1.65.0; extra == "pipelines" - grpcio-status
>=1.67.0; extra == "pipelines" - grpcio
>=1.67.0; extra == "pipelines" - numpy
>=1.21; extra == "pipelines" - pandas
>=1.0.5; extra == "pipelines" - pyarrow
>=10.0.0; extra == "pipelines" - pyyaml
>=3.11; extra == "pipelines" - zstandard
>=0.23.0; extra == "pipelines" - numpy
>=1.21; extra == "sql" - pandas
>=1.0.5; extra == "sql" - pyarrow
>=10.0.0; extra == "sql"
Databricks Connect
Databricks Connect allows you to connect popular IDEs such as Visual Studio Code, PyCharm, IntelliJ IDEA, notebook servers, and other custom applications to Databricks clusters.
Databricks Connect is a client library for the Databricks Runtime. It allows you to write code using Spark APIs and run them remotely on a Databricks cluster instead of in the local Spark session.
Refer to the official docs at https://docs.databricks.com/en/dev-tools/databricks-connect/python/index.html