This connector is used to read Detla table files using Spark.
⚠️ A spark connector can be use only with another spark connector. It is not possible to use a spark connector with a non spark connector.
See Spark documentation for more information.
Connection configuration #
No connection is required by this connector
Configuration #
Test case configuration #
| Name | Mandatory | Default | Description |
|---|---|---|---|
| path | yes | Path to the Delta table |
Example #
Example Delta Spark:
source:
type: delta_spark
path: data/employees
expected:
type: sql_spark
query: |
select *
from employees
where hire_date < "2000-01-01"
