What's New in GigaSpaces Version 15.2

Release Date: November-08-2022

Release Date: October-13-2022

Release Date: May-15-2022

Release Date: November-16-2021

Release Date: August-05-2021

This section describes product changes, along with new features and functionality for GigaSpaces release 15.2.

 

This version is early access, and there are currently no new features.

Introducing SpaceDeck

The new introductory version of the SpaceDeck User Interface is now available for Smart DIH users.

SpaceDeck is the ultimate command and control center for the Digital Integration Hub. Secure and fast data ops solution democratizes your data!

This introductory version does not cover all functionality and is intended as an introduction to the new UI and a supplement to our existing GigaSpaces Ops Manager, GigaSpaces Management Center (GS-UI) and Web Management Console (WEB-UI) UIs. SpaceDeck is initially available for SmartDIH installations, and will be extended in future releases to eventually replace the older UIs.

This introductory implementation of SpaceDeck includes the following features:

  • Spaces: display status, resource usage and error analysis of Spaces and related partitions.

  • Data Sources: specify the data source that will be used to provide data in a data pipeline.

    Data Pipeline: display data pipeline details such as source table in the System of Record, resulting Object in GigaSpaces, and parameters of the data connection. Also allows quick one-click creation of new data pipelines.

  • Data Query: Querying the data using SQL commands, supporting full ANSI SQL-99 syntax.

Data Pipeline/Data Integration Enhancements

SQL Enhancements

 

 

Data Pipeline/Data Integration Enhancements

  • Out of the box integration logic and generic data pipelines dramatically shortens time-to-market for new digital services and minimizes service downtime.

    • IBM Infosphere Data Replication (IIDR) is available as an out-of-the-box connector engine for data pipelines.

    • Data pipeline support is enhanced to include DB2 on IBM z/OS mainframe.

    • Generic declarative data loader can load any data based on configuration per data source.

    • Ensure business continuity while changing the data schema (adding tables) and reloading data.

 

SQL Enhancements

 

Enhanced Support for Kubernetes

  • Zoned Anti-Affinity ensures that the primary and backup partitions will not run in the same zone.

  • In Kubernetes, namespaces provides a mechanism for isolating groups of resources within a single cluster. Names of resources need to be unique within a namespace, but not across namespaces. We now support deploying to a namespace, as opposed to deploying to the default namespace.

 

Tiered Storage Enhancements

  • Local transactions are now supported in Tiered Storage.

  • Multiple Criteria Support: Tiered Storage criteria now supports multiple AND/OR expressions.

 

JDBC Driver Support for Tableau

 

Data Pipeline Improvement – Data Freshness

Data freshness is defined as time lag between updating the system of record, and seeing the corresponding update in the In-Memory Data Grid. Grafana alerts can now be implemented that are triggered if data freshness exceeds a parameter-specified time interval.

 

SQL Optimization and Enhancements

Enhanced SQL support provides more options for CRUD operations, and includes improved support for DDL statements on our high-performance JDBD/ODBC-enabled SQL engine.

 

New Kubernetes Supported Properties

The new configMap and statefulSet properties allow greater flexibility in customizing Helm charts.

 

Built-In Support of Compound Space Id

A compound key for a Space ID can now be specified for Space Objects and Document Objects without requiring custom code.

 

Improved Memory Management

Checks for Out of Memory conditions are now also performed internally to database operations, providing more fine-tuned memory management..

 

Common Event Format (CEF) Logs

The CEF log format is now supported for system logs.

 

Improvements to Redo Log

The redo log, used to preserve data in the event of a system disconnection, is now available in a standard SQLite database format that can be browsed via SQL commands. Redo log reliability has been hardened by removing restrictions on the amount of data that can be preserved.

 

Data Integration

Data Integration allows data to be loaded and continuously updated in the GigaSpaces data grid using easily-defined, reusable Data Pipelines that require no user code. Data Integration can access CDC-based connectors. This version introduces data integration from DB2 running on Z/OS.

Data Integration metrics according to your system configuration show data activity, including data volumes and statistics and any data validation errors or other access errors.

 

SQL Optimization and Enhancements

Enhanced SQL support provides extensive features for data queries. The initial implementation supports data integration from DB2 running on Z/OS.

 

Native Kubernetes Deployment

GigaSpaces has implemented the Kubernetes Custom Resources Definition (CRD) feature to allow use of the standard kubectl command to manage GigaSpaces resources. kubectl can now be used to deploy and manage GigaSpaces Spaces and GigaSpaces services.

 

Dot Net Core Support

GigaSpaces now introduces the new Dot Net Core, while preserving backward compatibility for Dot Net Framework. Applications using Dot Net Core and Dot Net Framework can run in parallel, allowing for easier migration to the newer framework.

 

Data Tiering

Intelligent Data Tiering allows you to better balance cost and performance:

  • Fast, relatively expensive RAM storage (Hot tier) for fast SQL queries

  • Less expensive SSD storage (Warm tier) for up to 20x increase in data capacity, reduced memory footprint, and minimal or no impact on system performance.

Enhancements to data tiering in release 16.0:

Data Persistency

  • Improved system resilency — local, synchronized persistency via tiered storage

    • The "undeploy" operation now only unregisters the service, with no need to reload data. The data is preserved and re-attached upon re-deploy.

    • New "delete" operation supports explicit data deletion requests

  • Faster deployment — automatically save and restore tiered data using the persistent data option. No need to perform full re-sync with system of record upon system restart.

Fast and Comprehensive SQL Engine

With this release, the new engine becomes the default for all SQL read operations. The support for old engines is kept for backward compatibility and will be reviewed for deprecation in a future release.

Data Gateway

  • Seamless integration with BI toolsPostgreSQL driver provides simplified integration for BI tools such as Power BI and Tableau.

  • Improved JDBC support and new ODBC support — enables lightweight clients, with simplified integration and faster time to value.

Improved Kubernetes Support

  • Docker-based deployment based on Kubernetes microservices design patterns — aligned with industry-standard CI/CD practices

  • Deploy and undeploy using native Kubernetes API

  • Openshift 4.4+ integration fully aligned with generic Kubernetes orchestration

Performance Improvements

Accumulated improvement potential of up to 50%:

  • Improvement to the serialization mechanism to reduce the overhead by 10-15%. This improvement is relevant for all workload types.

  • Improvement to the mechanism creating user objects (POJOs) increases performance by 10-15%.

  • Optimize thread configuration and performance with a single Communication Protocol parameter for 10-15% improvement. This optimization is mostly relevant for ID-based workloads.

Detailed Grafana Dashboards

Simpler and more effective monitoring using a new detailed Grafana-based dashboard of system status and metrics

Support for Secured Space

  • Secured Space can now be accessed via the standard GigaSpaces tools — CLI, REST-API, and Ops Manager — and the related proxy properties can be customized

  • Multi-user support

Cloud Native Orchestration
Kubernetes and ElasticGrid Improvements

This release provides the following improvement for Kubernetes- and ElasticGrid-based GigaSpaces applications:

  • Vertical Scaling - InsightEdge enables scaling up (more CPU/RAM) in 1-click per service, with no downtime and auto recovery across either Kubernetes and ElasticGrid
  • Horizontal Scaling (beta) - InsightEdge provides scaling out (more nodes) in 1-click on ElasticGrid. This feature is in beta mode and will be GA, including Kubernetes support, in the next release.
  • Hybrid Cloud - InsightEdge now provides auto installation in an hybrid cloud deployment on-prem and cloud with ElasticGrid.
  • Kubernetes Helm 3 - In addition to existing Helm 2 support, Helm 3 support has been added. In cases where the syntax differs between Helm 2 and Helm 3, examples are given in both formats, as shown here.

 

Services and Metadata

GigaSpaces includes new functionality to simplify the deployment of services, to allow access to a changed database schema without downtime, and to view real-time Space metadata and usage statistics.

  • Deploy Service - Ops Manager enables you to easily deploy any service from either a URL or a file
  • A/B Testing & Schema Evolution - InsightEdge now provides the ability to manage microservices deployment and versioning side-by-side in a production environment for A/B testing
  • On-Demand Object Analysis - Ops Manager shows the spaces and object metadata with visibility to the RAM footprint

Administration and Security

Improved visibility of system runtime data, expanded database connectivity, and enhanced troubleshooting and security options provide the GigaSpaces system administrator with the tools they need to keep the system running at optimal efficiency.

  • Index Usage Efficiency - Ops Manager and Grafana show the index hits and RAM footprint
  • Additional 1-Click Data Connectors - Expanded built-in data sources to include all the common RDBMS, both on-prem: Oracle, MS SQL, MySQL, Postgres and HSQL, and Cloud: Amazon RDS and Azure SQL.
  • Hardened Security - Out-of-a-box authentication and authorization of Ops Manager and the REST API
  • Troubleshooting - Ops Manager now provides a log viewer and shows an Explain Plan (beta) in the SQL editor
  • Asynchronous Persistency Enhancement - Apache Kafka can now be used as a buffer between the mirror service and the actual synchronization endpoint. This provides a reliable data pipeline for database persistence via an enhanced mirror service with Apache Kafka.

Third-Party Integration Updates

  • Hibernate has been updated to version 5.6.7.

Deprecated and End-Of-Life Features and Functionality

The following functionality is deprecated as of this release:

  • Entry and MetaDataEntry

  • Memcached integration

  • smart-augmented-transactions package

  • JMS Integration

  • GSIterator (use SpaceIterator instead)

  • Cassandra integration

  • Scala REPL tool

  • ESM/EPU

  • ElasticGrid

  • Mule integration

Third-Party Integration Updates

There are currently no third-party changes or updates.

Deprecated and End-Of-Life Features and Functionality

Deprecated and End-Of-Life Features and Functionality

There are no end-of-life or deprecated features in this release.

The following functionality is deprecated as of this release:

  • Entry and MetaDataEntry

  • Memcached integration

  • smart-augmented-transactions package

  • JMS Integration

  • GSIterator (use SpaceIterator instead)

  • Cassandra integration

  • Scala REPL tool

  • ESM/EPU

  • ElasticGrid

  • Mule integration

Third-Party Integration Updates

Tableau 2020.02 and 2020.03 are now supported.

Deprecated and End-Of-Life Features and Functionality

The following functionality is deprecated as of this release:

  • Helm 2

The following functionality is deprecated as of this release:

  • ElasticGrid

The following functionality is deprecated as of this release:

  • ESM