What’s New?
1. Blendata Logo Update
Update our platform logo and reorganize the margins of the feature menus.
2. Workflow Management Feature
The Workflow Management feature introduces powerful capabilities for optimizing processes through precise task sequencing, Success and Fail condition control, and streamlined chained job execution. Users gain greater flexibility and efficiency in organizing complex workflows, arranging tasks with precision, and ensuring automated execution proceeds uninterrupted until successful completion or specified fail conditions are met. This feature empowers users to enhance operational efficiency and customize process arrangement, making it a valuable tool for optimizing workflows.
- User-Friendly interface and diagram view for task management
Enhance your task management experience with a clean and accessible layout. Connecting the tasks by generating the diagram in the Workflow Editor.
- Manage the task with conditional logic
Able to define specific conditions under which a task is considered Success or Failed. This level of control ensures that subsequent tasks are executed based on the outcome of preceding ones.
- Custom setting and parameters for the particular execution
Able to create a custom configuration with the task for the particular execution.
- Historical performance summary
Summarize the historical tasks status and the performance in the simple visualization.
- Alert Notification In-app and email
To update the task status and alert when the workflow is failed via in-app notification or email.
- Workflow Version Management
Manage the historical workflow versions, enabling you to view, restore, and edit your work with ease.
- Automate workflow by Scheduling Time-Based Actions
Set up a schedule, ensuring that tasks and processes are executed precisely when needed, streamlining your operations and minimizing manual intervention.
3. CRUD Feature
As of now, users are limited to updating and inserting data into the table. However, with the introduction of the CRUD feature (advanced SQL mode) in Data Exploration, we have significantly enhanced this functionality to provide users with operational options. In this upgraded mode, users can interact with delta tables(relational database), granting them the capability to create, read, update, and delete records within the data asset. These expanded features provide users with greater flexibility and control over their data management processes.Open image-20231016-104552.png
CRUD feature has four types of the operations as following:
- Create: to create a new row and populate the field columns with data.
- Read: to search and retrieve specific records in the table and read their values with customized criteria.
- Update: to modify a value of the existing record.
- Delete: to remove the specified record from the data asset.
4. SQL Editor Workspace
Improve the Data Exploration menu, advanced users, who are familiar with the SQL command. Provide the data asset information and enable copy data table name or field name and replace the query in the workspace.
- Multi-Tab Workspace
The multi-tab workspace provides users with the ability to design their own SQL queries. Users can navigate between different open tabs within the workspace. Furthermore, the system retains the current workspace, allowing users to easily pick up where they left off.
- Simplify the data processing with data structure detail
Enables users to access essential data asset details, such as table names and field names, simplifying the data querying process.
- Store your SQL commands in My Queries
Save frequently used SQL queries in the ‘My Queries’ menu, allowing users to edit, share, and delete these queries as needed.
- SQL Query History
Retain the historical SQL Query and enable restoring the query within the workspace.
5. CDC Historical Improvement
Previously, users had the capability to handle Kafka connectors exclusively through the backend. We have now introduced a user-friendly menu within the website interface for managing Kafka connectors. This enhanced feature is easy to access and control the Kafka operational options, such as pausing, resuming, restarting, editing, deleting, and monitoring performance status. This update is designed to enhance operational efficiency and user experience.
Fixed Bug:
Import Asset (JSON file)
- BDEN-363 Resolved the error where users were unable to import view table data profiles into the platform using the Import Asset (JSON file) option.
Change Data Capture (CDC)
- BDEN-248 Delta table option removed from advanced options as the CDC feature does not support it.
- BDEN-512 Configure SQL server settings to support the use of a comma ‘;’ at the end of the connection URL.
- BDEN-520 Resolved the issue occurring when importing the same CDC table but the user saves the new data asset with the difference name.
- BDEN-528 Add the error massage prompt when the users attempt to use an existing data asset name for ORACLE, PostgreSQL, MySQL, and SQLServer types.
- BDEN-529 Fixed an issue with CDC import files where incomplete default fields were displayed or when the ‘Add Import Data default field’ option was unticked, preventing default fields from appearing in the preview data page.
- BDEN-530 Resolved a bug that occurred when users imported a new CDC data with the same name as a deleted data asset, causing the stream service historical data to display information from the deleted asset.
- BDEN-594 Resolved an issue where selected fields during the import data step and preview data on Data Catalog were not aligned.
Data Catalog
- BDEN-550 Resolved an issue with role/user permissions of Delta tables. When a user shares view permissions with another person, that individual should no longer be able to see the table option.
Simple Query
- BDEN-515 Fixed an error to synchronize the time range between the platform and output when users applied the time range in the Simple Query function and exported to a new aggregate table or files.
Dashboard
- BDEN-509 Resolved the issue of a blank screen when using the publish dashboard URL with the iframe function on the website page.
- BDEN-517 Fixed the issue related to filter values when using a single quote (‘) for timestamp filters.
Improvement:
SQL Query Highlight Execution
- BDEN-542 Able to highlight and execute a specific SQL query to get the result in Data Exploration and SQL Editor menu.
Stream History and Job History loading
- BDEN-561 Enhanced the loading speed for displaying results in Stream History and Job History on the Service Management page.
Spark Version
- BDEN-564 Updated the Spark version from v3.2 to v3.3.
Notebook
- BDEN-617 Added the module ID and Notebook ID information on the Notebook page.
