databricks-connect16.0.0
databricks-connect16.0.0
Published
Databricks Connect Client
pip install databricks-connect
Package Downloads
Authors
Requires Python
>=3.10
Dependencies
- databricks-sdk
>=0.29.0 - googleapis-common-protos
>=1.56.4 - grpcio-status
>=1.59.3 - grpcio
>=1.59.3 - numpy
<2,>=1.15 - packaging
>=23.2 - pandas
>=1.0.5 - py4j
==0.10.9.7 - pyarrow
>=4.0.0 - setuptools
>=68.0.0 - six
- googleapis-common-protos
>=1.56.4; extra == "connect" - grpcio-status
>=1.59.3; extra == "connect" - grpcio
>=1.59.3; extra == "connect" - numpy
<2,>=1.15; extra == "connect" - pandas
>=1.0.5; extra == "connect" - pyarrow
>=4.0.0; extra == "connect" - numpy
<2,>=1.15; extra == "ml" - numpy
<2,>=1.15; extra == "mllib" - numpy
<2,>=1.15; extra == "pandas-on-spark" - pandas
>=1.0.5; extra == "pandas-on-spark" - pyarrow
>=4.0.0; extra == "pandas-on-spark" - numpy
<2,>=1.15; extra == "sql" - pandas
>=1.0.5; extra == "sql" - pyarrow
>=4.0.0; extra == "sql"
Databricks Connect
Databricks Connect allows you to connect popular IDEs such as Visual Studio Code, PyCharm, IntelliJ IDEA, notebook servers, and other custom applications to Databricks clusters.
Databricks Connect is a client library for the Databricks Runtime. It allows you to write code using Spark APIs and run them remotely on a Databricks cluster instead of in the local Spark session.
Refer to the official docs at https://docs.databricks.com/en/dev-tools/databricks-connect/python/index.html