Legacy Processing Components

Estimated reading: 7 minutes 169 views

The following Processing components are legacy components. You can still use them in your flows, but they are no longer supported and can be removed in a future release.

Replace these components with suggested alternatives as soon as possible.

Replace this legacy component with the Data Operations component.

Name Display Name Info
input_value Input Input parameter. Objects to which Metadata should be added.
text_in User Text Input parameter. Text input; the value is contained in the 'text' attribute of the Data object. Empty text entries are ignored.
metadata Metadata Input parameter. Metadata to add to each object.
remove_fields Fields to Remove Input parameter. Metadata fields to remove.
data Data Output parameter. List of Input objects, each with added metadata.

Combine/ Merge data

 Replace this legacy component with the Data Operations component or the Loop component.

This component combines multiple data sources into a single unified Data object.

The component iterates through a list of Data objects, merging them into a single Data object (merged_data). If the input list is empty, it returns an empty data object. If there’s only one input data object, it returns that object unchanged.

The merging process uses the addition operator to combine data objects.

Combine text

Replace this legacy component with the Data Operations component.

This component concatenates two text inputs into a single text chunk using a specified delimiter, outputting a Message object with the combined text.

Create Data

Replace this legacy component with the Data Operations component.

This component dynamically creates a Data object with a specified number of fields and a text key.

It accepts the following parameters:

Name Display Name Info
number_of_fields Number of Fields Input parameter. The number of fields to be added to the record.
text_key Text Key Input parameter. Key that identifies the field to be used as the text content.
text_key_validator Text Key Validator Input parameter. If enabled, checks if the given Text Key is present in the given Data.

Extract Key

Replace this legacy component with the Data Operations component.

This component extracts a specific key from a Data object and returns the value associated with that key.

Data to DataFrame/Data to Message

Replace these legacy components with newer Processing components, such as the Data Operations component and Type Convert component.

These components converted one or more Data objects into a DataFrame or Message object.

For the Data to DataFrame component, each Data object corresponds to one row in the resulting DataFrame. Fields from the .data attribute become columns, and the .text field (if present) is placed in a text column.

Filter Data

Replace this legacy component with the Data Operations component.

This component filters a Data object based on a list of keys (filter_criteria), returning a new Data object (filtered_data) that contains only the key-value pairs that match the filter criteria.

Filter Values

Replace this legacy component with the Data Operations component.

The Filter values component filters a list of data items based on a specified key, filter value, and comparison operator.

It accepts the following parameters:

Name Display Name Info
input_data Input data Input parameter. The list of data items to filter.
filter_key Filter Key Input parameter. The key to filter on.
filter_value Filter Value Input parameter. The value to filter by.
operator Comparison Operator Input parameter. The operator to apply for comparing the values.
filtered_data Filtered data Output parameter. The resulting list of filtered data items.

JSON Cleaner

Replace this legacy component with the Parser component.

This component cleans JSON strings to ensure they are fully compliant with the JSON specification.

It accepts the following parameters:

Name Display Name Info
json_str JSON String Input parameter. The JSON string to be cleaned. This can be a raw, potentially malformed JSON string produced by language models or other sources that may not fully comply with JSON specifications.
remove_control_chars Remove Control Characters Input parameter. If set to True, this option removes control characters (ASCII characters 0–31 and 127) from the JSON string. This can help eliminate invisible characters that might cause parsing issues or make the JSON invalid.
normalize_unicode Normalize Unicode Input parameter. When enabled, this option normalizes Unicode characters in the JSON string to their canonical composition form (NFC). This ensures consistent representation of Unicode characters across different systems and prevents potential issues with character encoding.
validate_json Validate JSON Input parameter. If set to True, this option attempts to parse the JSON string to ensure it is well-formed before applying the final repair operation. It raises a ValueError if the JSON is invalid, allowing for early detection of major structural issues in the JSON.
output Cleaned JSON String Output parameter. The resulting cleaned, repaired, and validated JSON string that fully complies with the JSON specification.

Message to Data

Replace this legacy component with the Type Convert component.

This component converts Message objects to Data objects.

Parse DataFrame

Replace this legacy component with the DataFrame Operations component or Parser component.

This component converts DataFrame objects into plain text using templates.

It accepts the following parameters:

Name Display Name Info
df DataFrame Input parameter. The DataFrame converts to text rows.
template Template Input parameter. Template for formatting (use {column_name} placeholders).
sep Separator Input parameter. String to join rows in output.
text Text Output parameter. All rows combined into single text.

Parse JSON

Replace this legacy component with the Parser component.

This component converts and extracts JSON fields in Message and Data objects using JQ queries, then returns filtered_data, which is a list of Data objects.

Python REPL

Replace this legacy component with the Python Interpreter component or another processing or logic component.

This component creates a Python REPL (Read-Eval-Print Loop) tool for executing Python code.

It accepts the following parameters:

Name Type Description
name String Input parameter. The name of the tool. Default: python_repl.
description String Input parameter. A description of the tool's functionality.
global_imports List[String] Input parameter. A list of modules to import globally. Default: math.
tool Tool Output parameter. A Python REPL tool for use.

Python Code Structured

Replace this legacy component with the Python Interpreter component or another processing or logic component.

This component creates a structured tool from Python code using a dataclass.

The component dynamically updates its configuration based on the provided Python code, allowing for custom function arguments and descriptions.

It accepts the following parameters:

Name Type Description
tool_code String Input parameter. The Python code for the tool's dataclass.
tool_name String Input parameter. The name of the tool.
tool_description String Input parameter. Description of the tool.
return_direct Boolean Input parameter. Whether to return the function output directly.
tool_function String Input parameter. The selected function for the tool.
global_variables Dict Input parameter. Global variables or data for the tool.
result_tool Tool Output parameter. A structured tool created from the Python code.

Regex Extractor

Replace this legacy component with the Parser component.

This component extracts patterns in text using regular expressions. It can be used to find and extract specific patterns or information in text.

 Select Data

Replace this legacy component with the Data Operations component.

This component selects a single Data object from a list.

It accepts the following parameters:

Name Display Name Info
data_list Data List Input parameter. List of data to select from
data_index Data Index Input parameter. Index of the data to select
selected_data Selected Data Output parameter. The selected Data object.

Update Data

Replace this legacy component with the Data Operations component.

This component dynamically updates or appends data with specified fields.

It accepts the following parameters:

Name Display Name Info
old_data Data Input parameter. The records to update.
number_of_fields Number of Fields Input parameter. The number of fields to add. The maximum is 15.
text_key Text Key Input parameter. The key to text content.
text_key_validator Text Key Validator Input parameter. Validates the text key presence.
data Data Output parameter. The updated Data objects.
Share this Doc

Legacy Processing Components

Or copy link

CONTENTS