...
Attribute | ID | Type | Required | Description | |
|---|---|---|---|---|---|
Host | host | 1.0 | String | Yes | The IP or Hostname of the Splunk Server to connect to |
Port | port | 1.0 | Integer | No | The port to connect to, defaults to 8000 |
Username | username | 1.0 | String | Yes | The username to connect as |
Password | password | 1.0 | String | Yes | The password to authenticate with. |
PDI JDBC Data Service
Element type name: Kettle Data Service
Element type description: The elements describing data services based upon transformation output. Data services are an EE feature that allows a transformation to be used as the backing for queries from any client using a standard JDBC driver.
Element type source file: com/pentaho/di/transformation/dataservice/DataServiceMeta.java
Element type hierarchy:
- Kettle Data Service** <attributes>** push_down_opt_meta - List of Push Down Optimization elements** <attributes>** fieldMappings - Map of Source Target Field elements**** <attributes>
Element Attributes:
Attribute | ID | API Version | Type | Required | Description | Source File |
|---|---|---|---|---|---|---|
Name | name | 1.0 | String | Yes | The name of the data service, which will be used as the table name visible to a jdbc client. | c.p.d.t.dataservice.DataServiceMeta @MetaStoreAttribute |
Step name | stepname | 1.0 | String | Yes | (Name change upcoming in 2.1) The name of the service step (i.e. the step whose fields will be exposed to the jdbc client) | c.p.d.t.dataservice.DataServiceMeta @MetaStoreAttribute |
Object ID | transformation_rep_object_id | 1.0 | String | Yes (one of set A) | rep: by reference (1st priority) | c.p.d.t.dataservice.DataServiceMeta.DATA_SERVICE_TRANSFORMATION_REP_OBJECT_ID |
Path | transformation_rep_path | 1.0 | String | Yes (one of set A) | rep: by name (2nd priority) | c.p.d.t.dataservice.DataServiceMeta.DATA_SERVICE_TRANSFORMATION_REP_PATH |
Transformation filename | transformation_filename | 1.0 | String | Yes (one of set A) | file: (3rd priority) | c.p.d.t.dataservice.DataServiceMeta.DATA_SERVICE_TRANSFORMATION_FILENAME |
Cache method | cache_method | 1.0 | String (enum) | No | Reference to ServiceCacheMethod (none or local memory); need more details. | c.p.d.t.dataservice.DataServiceMeta.DATA_SERVICE_CACHE_METHOD |
Cache max age | cache_max_age_minutes | 1.0 | int | Yes (If cache_method) | In minutes | c.p.d.t.dataservice.DataServiceMeta.DATA_SERVICE_CACHE_MAX_AGE_MINUTES |
push_down_opt_meta | push_down_opt_meta | 2.0 | List<PushDownOptimizationMeta> | No | List of PushDownOptimizationMeta entries configured for this data service | c.p.d.t.dataservice.DataServiceMeta.PUSH_DOWN_OPT_META |
PDI JDBC DS - Push Down Optimization
Element type name: Push Down Optimization
Element type description: Defines opportunities to improve Data Service performance by modifying user transformation execution. The ETL developer configures these optimizations in the data service and when client queries come in that can be optimized by pushing down into the source transformation, these configurations determine how it is done.
Element type source file: com/pentaho/di/transformation/dataservice/optimization/PushDownOptimizationMeta.java
Element Attributes:
Attribute | ID | API Version | Type | Required | Description | Source File |
|---|---|---|---|---|---|---|
Optimization name | name | 2.0 | String | Yes | User-defined name for this optimization (required) | c.p.d.t.dataservice.optimization.PushDownOptimizationMeta @MetaStoreAttribute |
Step name | stepName | 2.0 | String | Yes | (Name change upcoming in 2.1) Name of the step being optimized (optional) | c.p.d.t.dataservice.optimization.PushDownOptimizationMeta @MetaStoreAttribute |
Push down type | type | 2.0 | PushDownType | Yes | Currently only "Parameter Generation" is implemented | c.p.d.t.dataservice.optimization.PushDownOptimizationMeta @MetaStoreAttribute |
Push down enabled | enabled | 2.0 | boolean | Yes |
| c.p.d.t.dataservice.optimization.PushDownOptimizationMeta @MetaStoreAttribute |
Optimization form | form | 2.0 | OptimizationForm (enum) | Yes | Currently only "Where Clause" is implemented. "Filter" coming shortly. Defines the way to prefix the clause, i.e. with "WHERE" or with an "AND" | c.p.d.t.dataservice.optimization.paramgen.ParameterGeneration @MetaStoreAttribute |
Field mappings | fieldMappings | 2.0 | List<SourceTargetFields> | Yes | (Name change upcoming in 2.1) | c.p.d.t.dataservice.optimization.paramgen.ParameterGeneration @MetaStoreAttribute |
Parameter name | parameterName | 2.0 | String | Yes | (Name change upcoming in 2.1) The variable in the SQL statement of the Table Input step that should be interpolated with the pushed down conditions | c.p.d.t.dataservice.optimization.paramgen.ParameterGeneration @MetaStoreAttribute |
PDI JDBC DS - Source Target Fields
Element type name: Source Target Fields
Element type description: Defines the mapping of a source to target field and any related metadata. Used for push down optimization.
Element type source file: com/pentaho/di/transformation/dataservice/optimization/SourceTargetFields.java
Element Attributes:
Attribute | ID | API Version | Type | Required | Description | Source File |
|---|---|---|---|---|---|---|
Source field name | sourceFieldName | 2.0 | String | Yes | (Name change upcoming in 2.1) The column name for which to search the incoming SQL | c.p.d.t.dataservice.optimization.SourceTargetFields @MetaStoreAttribute |
Target field name | targetFieldName | 2.0 | String | Yes | (Name change upcoming in 2.1) The column name in the Table Input step to which it is mapped. | c.p.d.t.dataservice.optimization.SourceTargetFields @MetaStoreAttribute |
Big Data Plugin - Hadoop Named Cluster
...