Legacy Processing Components
The following Processing components are legacy components. You can still use them in your flows, but they are no longer supported and can be removed in a future release.
Replace these components with suggested alternatives as soon as possible.
Replace this legacy component with the Data Operations component.
Name | Display Name | Info |
---|---|---|
input_value | Input | Input parameter. Objects to which Metadata should be added. |
text_in | User Text | Input parameter. Text input; the value is contained in the 'text' attribute of the Data object. Empty text entries are ignored. |
metadata | Metadata | Input parameter. Metadata to add to each object. |
remove_fields | Fields to Remove | Input parameter. Metadata fields to remove. |
data | Data | Output parameter. List of Input objects, each with added metadata. |
Combine/ Merge data
Replace this legacy component with the Data Operations component or the Loop component.
This component combines multiple data sources into a single unified Data object.
The component iterates through a list of Data objects, merging them into a single Data object (merged_data). If the input list is empty, it returns an empty data object. If there’s only one input data object, it returns that object unchanged.
The merging process uses the addition operator to combine data objects.
Combine text
Replace this legacy component with the Data Operations component.
This component concatenates two text inputs into a single text chunk using a specified delimiter, outputting a Message object with the combined text.
Create Data
Replace this legacy component with the Data Operations component.
This component dynamically creates a Data object with a specified number of fields and a text key.
It accepts the following parameters:
Name | Display Name | Info |
---|---|---|
number_of_fields | Number of Fields | Input parameter. The number of fields to be added to the record. |
text_key | Text Key | Input parameter. Key that identifies the field to be used as the text content. |
text_key_validator | Text Key Validator | Input parameter. If enabled, checks if the given Text Key is present in the given Data. |
Extract Key
Replace this legacy component with the Data Operations component.
This component extracts a specific key from a Data object and returns the value associated with that key.
Data to DataFrame/Data to Message
Replace these legacy components with newer Processing components, such as the Data Operations component and Type Convert component.
These components converted one or more Data objects into a DataFrame or Message object.
For the Data to DataFrame component, each Data object corresponds to one row in the resulting DataFrame. Fields from the .data attribute become columns, and the .text field (if present) is placed in a text column.
Filter Data
Replace this legacy component with the Data Operations component.
This component filters a Data object based on a list of keys (filter_criteria), returning a new Data object (filtered_data) that contains only the key-value pairs that match the filter criteria.
Filter Values
Replace this legacy component with the Data Operations component.
The Filter values component filters a list of data items based on a specified key, filter value, and comparison operator.
It accepts the following parameters:
Name | Display Name | Info |
---|---|---|
input_data | Input data | Input parameter. The list of data items to filter. |
filter_key | Filter Key | Input parameter. The key to filter on. |
filter_value | Filter Value | Input parameter. The value to filter by. |
operator | Comparison Operator | Input parameter. The operator to apply for comparing the values. |
filtered_data | Filtered data | Output parameter. The resulting list of filtered data items. |
JSON Cleaner
Replace this legacy component with the Parser component.
This component cleans JSON strings to ensure they are fully compliant with the JSON specification.
It accepts the following parameters:
Name | Display Name | Info |
---|---|---|
json_str | JSON String | Input parameter. The JSON string to be cleaned. This can be a raw, potentially malformed JSON string produced by language models or other sources that may not fully comply with JSON specifications. |
remove_control_chars | Remove Control Characters | Input parameter. If set to True, this option removes control characters (ASCII characters 0–31 and 127) from the JSON string. This can help eliminate invisible characters that might cause parsing issues or make the JSON invalid. |
normalize_unicode | Normalize Unicode | Input parameter. When enabled, this option normalizes Unicode characters in the JSON string to their canonical composition form (NFC). This ensures consistent representation of Unicode characters across different systems and prevents potential issues with character encoding. |
validate_json | Validate JSON | Input parameter. If set to True, this option attempts to parse the JSON string to ensure it is well-formed before applying the final repair operation. It raises a ValueError if the JSON is invalid, allowing for early detection of major structural issues in the JSON. |
output | Cleaned JSON String | Output parameter. The resulting cleaned, repaired, and validated JSON string that fully complies with the JSON specification. |
Message to Data
Replace this legacy component with the Type Convert component.
This component converts Message objects to Data objects.
Parse DataFrame
Replace this legacy component with the DataFrame Operations component or Parser component.
This component converts DataFrame objects into plain text using templates.
It accepts the following parameters:
Name | Display Name | Info |
---|---|---|
df | DataFrame | Input parameter. The DataFrame converts to text rows. |
template | Template | Input parameter. Template for formatting (use {column_name} placeholders). |
sep | Separator | Input parameter. String to join rows in output. |
text | Text | Output parameter. All rows combined into single text. |
Parse JSON
Replace this legacy component with the Parser component.
This component converts and extracts JSON fields in Message and Data objects using JQ queries, then returns filtered_data, which is a list of Data objects.
Python REPL
Replace this legacy component with the Python Interpreter component or another processing or logic component.
This component creates a Python REPL (Read-Eval-Print Loop) tool for executing Python code.
It accepts the following parameters:
Name | Type | Description |
---|---|---|
name | String | Input parameter. The name of the tool. Default: python_repl. |
description | String | Input parameter. A description of the tool's functionality. |
global_imports | List[String] | Input parameter. A list of modules to import globally. Default: math. |
tool | Tool | Output parameter. A Python REPL tool for use. |
Python Code Structured
Replace this legacy component with the Python Interpreter component or another processing or logic component.
This component creates a structured tool from Python code using a dataclass.
The component dynamically updates its configuration based on the provided Python code, allowing for custom function arguments and descriptions.
It accepts the following parameters:
Name | Type | Description |
---|---|---|
tool_code | String | Input parameter. The Python code for the tool's dataclass. |
tool_name | String | Input parameter. The name of the tool. |
tool_description | String | Input parameter. Description of the tool. |
return_direct | Boolean | Input parameter. Whether to return the function output directly. |
tool_function | String | Input parameter. The selected function for the tool. |
global_variables | Dict | Input parameter. Global variables or data for the tool. |
result_tool | Tool | Output parameter. A structured tool created from the Python code. |
Regex Extractor
Replace this legacy component with the Parser component.
This component extracts patterns in text using regular expressions. It can be used to find and extract specific patterns or information in text.
Select Data
Replace this legacy component with the Data Operations component.
This component selects a single Data object from a list.
It accepts the following parameters:
Name | Display Name | Info |
---|---|---|
data_list | Data List | Input parameter. List of data to select from |
data_index | Data Index | Input parameter. Index of the data to select |
selected_data | Selected Data | Output parameter. The selected Data object. |
Update Data
Replace this legacy component with the Data Operations component.
This component dynamically updates or appends data with specified fields.
It accepts the following parameters:
Name | Display Name | Info |
---|---|---|
old_data | Data | Input parameter. The records to update. |
number_of_fields | Number of Fields | Input parameter. The number of fields to add. The maximum is 15. |
text_key | Text Key | Input parameter. The key to text content. |
text_key_validator | Text Key Validator | Input parameter. Validates the text key presence. |
data | Data | Output parameter. The updated Data objects. |