Changelog

This section lists the changes that were made to GigaSpaces products for 15.2. This version is early access, so the documentation is in draft form and subject to change.

 

16.4

Features and Enhancements

  • GS-14979: Upgrade tierStorage jdbc package to avoid security vulnerability
  • GS-14902: Flush redolog to disk in a shutdown if redolog was not cleared

Resolved Issues

  • GS-14980: Upgrade SnakeYaml due to security vulnerability
  • GS-14943: Upgrade roksdb to the latest version (8.1.1)
  • GS-14955: Spring framework cve
  • GS-14964: Executing a query when the match is done on a BigDecimal fails
  • GS-14973: SpaceDeck not responsive moving between tabs when space include large number of types & data
  • GS-14962: Upgrade spring to latest version possible with product java that avoid security vulnerabilities
  • GS-14947: After upgrading to 16.2 -IllegalArgumentException in readByIds from local cache when only one ID is included and routing same as id
  • GS-14951: BigDecimal comparison failing due to scientific notation scale value
  • GS-14952: Recovery of backup doesn't recover all operations in case intensive transactions are done while recovering
  • GS-14945: Flush redolog to disk should flush code map even when there no packets to flush

16.3

Features and Enhancements

  • GS-14552: Add support for using customer certificate for REST manager of jks format
  • GS-14532: Add support for passing configurations to K8s pod pu properties & env variables as yaml
  • GS-14836: Add support to add dynamic index in tiered storage, and allow to remove it before writing to tier
  • GS-14919: Tiered storage configuration is missing data
  • GS-14873: Zookeeper upgrade to (at least) 3.6.0 (vulnerability + integration)

Resolved Issues

  • GS-14939: Duplicate results when query is performed under certain set of conditions
  • GS-14899: Pipeline - Failed to "add table" when the DB2 table contains a unique Index but not PK
  • GS-14914: DI waste RAM by converting SMALLINT to Integer instead of Short
  • GS-14921: Drop type causes NPE in Ops-ui and space view not shown
  • GS-14918: Tiered Storage recovery from database fails in case of criteria including multiple conditions
  • GS-14733: Increased memory usage of MarshalOutputStream in CPeer/Writer

16.2.1

Resolved Issues

  • GS-14006: Aggregate causes a NPE when type definition is missing in one of the partitions
  • GS-14825: Object should not remain locked when related transaction throws exception in commit
  • GS-14848: Unable to replicate to mirror due to regex pattern syntax exception after upgrade
  • GS-14882: Memory leak and OOM due to incomplete AdminAPI Cleanup
  • GS-14883: Upgrade Spring & Spring security to 5.3.22 and 5.6.2 or higher
  • GS-14889: LUS memory consumption increases when using Spring Boot Space PU

Known Issues

  • GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
  • GS-14742: smart-externalizable classcastexception when PUs share a GSC

  • As explained in the Jiras, these issues can be addressed by specifying the parameter -Dcom.gs.smart-externalizable.enabled=false

  • GS-14893: Hibernate integration - fail to fetch eagerly collection with 5.6.7 hibernate version

 

16.2

Features and Enhancements

  • GS-14756: Vulnerability in Netty version (4.1.65.Final)
  • GS-14272: Experimental API to unregister type descriptor
  • GS-14779: Validate CR8 stream JSON file by the "load configuration" button
  • GS-14728: Enhance SpaceId to support multiple properties
  • GS-14776: ManagerClusterInfo Initialization on Admin – improve mechanism to avoid incorrect initialization due to discovery events order
  • GS-14758: Expose InfluxDB metrics via REST
  • GS-14746: Add global atomic counter for Manager REST requests
  • GS-14626: Add audit for secured service grid - Audit for operations that cause a change in the grid
  • GS-14741: Support CEF log messages
  • GS-14711: Enhance replication to replicate drop type to backup
  • GS-14627: WEB-UI - Add audit information
  • GS-14723: Set Zeppelin Jdbc Interpreter to run with v3 driver
  • GS-14688: Java 17 support
  • GS-14624: Add ability to support https connection to influxdb
  • GS-14570: upgrade commons-compress to latest version 1.21

Resolved Issues

  • GS-14885: OPS UI does not display in Tiered Storage configuration types registered with criteria, if Tiered Storage also configured in Space
  • GS-14826: In OPS UI, criteria do not show in Space configuration when dynamically registering type with tier criteria
  • GS-14887: Null pointer exception when trying to evict objects in Tiered Storage space
  • GS-14872: Redo log using SQLite fails to deserialize operations when involved objects contain an enum, or when serial number of a member field class is not the same as the space class
  • GS-14857: Kubernetes – no support for installing more than one PU using an umbrella chart
  • GS-14860: Clean up after uninstalling umbrella chart in Kubernetes
  • GS-14867: Kubernetes – support anti-affinity between zones
  • GS-14790: REST API – query Space data fails after failover
  • GS-14800: Pipeline - Failure to retrieve pipelines caused Spaces and Services Overview to become unavailable in ops-ui
  • GS-14805: Pipeline - the Consumer avoids existing messages if space is redeployed
  • GS-14809: Pipeline - Consumer failed on null value when a value of a property which is part of compound id is null
  • GS-14812: Pipeline - Consumer Fail to consume without logging any error
  • GS-14443: Data loss due to instances disconnections from ZooKeeper due to long garbage collection
  • GS-14744: Unwanted stdout logging in 16.1
  • GS-14799: Primary failed to recover from SQLite due to Date ClassCastException, causing data loss
  • GS-14776: ManagerClusterInfo Initialization on Admin – improve mechanism to avoid incorrect initialization due to discovery events order
  • GS-14745: Remove unwanted stdout logging in DocumentProperties
  • GS-14615: Chaining aggregators logic not working with GroupByAggregator in 15.8.1 version

Known Issues

  • GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
  • GS-14742: smart-externalizable classcastexception when PUs share a GSC

  • As explained in the Jiras, these issues can be addressed by specifying the parameter -Dcom.gs.smart-externalizable.enabled=false

  • GS-14893: Hibernate integration - fail to fetch eagerly collection with 5.6.7 hibernate version

 

16.1.1

Features and Enhancements

  • GS-14184: Support Compound Space ID with Space Document
  • GS-14354: Protect server from OOM caused by Client request
  • GS-14734: Add placeholder for service account in Helm charts
  • GS-14272: Experimental API to unregister type descriptor

Resolved Issues

  • GS-14819: Hibernate security vulnerability - upgrade 3rd party jar to latest release each new release of GS version
  • GS-14815: Data loss due to Redolog corruption caused by ConcurrentModificationException
  • GS-14829: Incorrect "failed" and "discarded" metrics from mirror
  • GS-14352: Redolog can't be read and will keep growing if redolog went to disk and change operations were done by 14.0 or older clients on 14.2 or newer server
  • GS-14764: Failed to deploy Consumer in tiered storage space due to missing dynamic properties restriction in the type definition
  • GS-14801: Consumer of CDC: Inability to resume initial load (full sync) in case of an error
  • GS-14802: CDC consumer cannot resume stream activity to space after an error
  • GS-14353: Add ability to recover corrupted redolog by skipping record that can't be deserialized
  • GS-14786: Pipeline – need to add an option to control (override) the starting offset
  • GS-14643: NPE when doing clear operation when clear is the first operation done by the client (regression starting 15.8)
  • GS-14468: Can't use broadcast table if table extends any base class
  • GS-14185: Support drops all Class's entries and all its templates from the space

Known Issues

  • GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
  • GS-14742: smart-externalizable classcastexception when PUs share a GSC
  • GS-14893: Hibernate integration - fail to fetch eagerly collection with 5.6.7 hibernate version

As explained in the Jiras, these issues can be addressed by specifying the parameter -Dcom.gs.smart-externalizable.enabled=false

 

16.1

Features and Enhancements

  • GS-14607: When securing webui using ssl, passwords should not be passed in using system properties
  • GS-14606: Configuring ssl with webui keyManagerPassword should not be required
  • GS-14566: Allow coding Instance SLA - currently class path issue
  • GS-14586: Upgrade Netty to 4.1.66
  • GS-14587: Upgrade H2 to 1.4.200
  • GS-14581: Add property for Primary Key First
  • GS-14573: Support SUM aggregation with scalar
  • GS-14572: upgrade Avatica to 1.18.0

Resolved Issues

  • GS-14615: Chaining aggregators logic not working with GroupByAggregator in 15.8.1 version
  • GS-14591: xap-jdbc.jar is not installed when running "gs maven install" command
  • GS-14557: Unable to run with Custom SSL Filter using manager due to class loader issues
  • GS-14553: GS_LUS_OPTIONS for xmx are not taken when gs script runs without a manager
  • GS-14571: NPE when running query with NULLIF

Known Issues

  • GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
  • GS-14742: smart-externalizable classcastexception when PUs share a GSC

As explained in the Jiras, these issues can be addressed by specifying the parameter -Dcom.gs.smart-externalizable.enabled=false

 

16.0

Features and Enhancements

  • GS-14520: Improve array creation for user-defined types using bytecode generation
  • GS-14531: Remove user home dir usage
  • GS-14519: Cursor iterator supports LRU space
  • GS-14506: Improve performance of auto-generated default factory
  • GS-14508: Add SmartExternalizable interface to optimize serialization
  • GS-14515: Upgrade Spring Security to 5.5.0
  • GS-14514: Upgrade Spring to 5.3.7
  • GS-14510: Enable/disable transport version detection via environment variable or system property
  • GS-14509: Improve platform version comparison
  • GS-14517: Generate wrapper classes from the UI
  • GS-14463: Kubernetes increase liveness probe values
  • GS-14497: Add environment variables for common LRMI settings
  • GS-14496: Change default LRMI port from 0 to 8200-8299
  • GS-14492: Upgrade Jetty to 9.4.40
  • GS-14487: Enhance Java version parsing to support early access builds
  • GS-14486: Add user name to system report in beginning of log
  • GS-14473: Upgrade hsqldb version from 2.3.2 to 2.5.2
  • GS-14474: Support running Docker and Kubernetes as non-root user
  • GS-14478: Improve Space clear with null template when Space contains broadcast table
  • GS-14475: Support loading "com.gs.security.properties-file" from url
  • GS-14476: Support loading "java.util.logging.config.file" from url
  • GS-14477: Support loading "com.gigaspaces.metrics.config" from url
  • GS-14429: Issue with deploying Manager to multiple namespace in K8s (GS-15.8)
  • GS-14415: Match performance of read/takeByIds with a single Id to that of read/takeById API
  • GS-14389: Move heap report to zookeeper
  • GS-14391: Upgrade Spring Security to 5.4.2
  • GS-14390: Upgrade Spring to 5.2.12
  • GS-14387: End of Life - Sigar integration

Resolved Issues

  • GS-14551: REST V2 - Fix REST-API for getting requests info
  • GS-14540: Fail to start local view inside Kubernetes cluster
  • GS-14539: java.lang.NumberFormatException: For input string: "∞"
  • GS-14537: java.sql.SQLException: Statement is invalid while deleting rows from tables - hsqldb version must be changed back to 2.3.2
  • GS-14518: ClassCastException thrown when select query with wrong date/time format executed on indexed date/time class variable
  • GS-14479: Unable to change zookeeper clientPort
  • GS-14465: Allow to configure security in Kubernetes
  • GS-14458: First-app example missing slf4j dependency
  • GS-14460: Concurrent modification bug in system task
  • GS-14409: Can't connect to a secured space using Ops Manager, or to query data in the rest API
  • GS-14421: Quiesce Mode during fail over is not resolved even after the curator client already reports RECONNECTED
  • GS-14438: Default Cursor iterator does not support LRU space
  • GS-14435: Default Cursor iterator does not support local view
  • GS-14450: NPE running cursor iterator in DEBUG log level
  • GS-14399: Upgrade from 14.5 to 15.x - ClusterInfo.getInstanceId() is wrong in some conditions
  • GS-14442: "Templating dataTypeName" error in Grafana v7.4.1 when displaying Space Object Type Index Metrics
  • GS-14442: "Templating dataTypeName" error in Grafana v7.4.1 when displaying Space Object Type Index Metrics
  • GS-14427: Kubernetes operator - Pass LRMI properties to PU
  • GS-14426: Kubernetes operator - Pass license to Kubernetes manager
  • GS-14423: Replace null values with "N/A" to avoid write failure In Constructor OSVendorDetails caused by Oshi version not supporting MacOs version
  • GS-14422: Block unauthorized features in REST and Ops-UI
  • GS-14417: REST: Path variable with dot (.) is truncated in URL
  • GS-14388: Upgrade from 12.3 to 15.5.1 log regression — unable to create log per PU using slf4j logger api and Log4j configuration
  • GS-14404: Service Dump does not complete if an exception is thrown during operation
  • GS-14406: Add scroll bar for data types and indexes table
  • GS-14396: Query time shown in OpsManager is incorrect
  • GS-14400: Scale operation on single Space should not be allowed
  • GS-14401: Service card is green despite number of actual instances greater than planned
  • GS-14395: Logging mismatch between context and log name
  • GS-14398: Kubernetes scale up doesn't allow scale up/down right after first scale without changing the last values (OPS-UI)
  • GS-14393: OPS-UI: NPE while writing to single space
  • GS-14394: Deploying/undeploying a space succeeds but returns an operation timeout in the CLI
  • GS-14392: Operation fails when scale up/down in Kubernetes is performed with same existing resource (Memory/CPU) values
  • GS-14386: Zeppelin Notebook and Spark examples use the same case class

Known Issues

  • GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
  • GS-14742: smart-externalizable classcastexception when PUs share a GSC

As explained in the Jiras, these issues can be addressed by specifying the parameter -Dcom.gs.smart-externalizable.enabled=false

15.5.1

Features and Enhancements

  • GS-14242: ElasticGrid - improve life cycle of processing units
  • GS-14277: ElasticGrid - allow public access for AWS Cluster
  • GS-14267: ElasticGrid - use AWS credentials from the client host for node add/remove commands
  • GS-14263: ElasticGrid - Use --server=<node-ip> to communicate with cluster
  • GS-14264: ElasticGrid - ask for confirmation when running destroy command
  • GS-14251: Define liveness health check and cancel restarts in readiness health check for stateful service on ElasticGrid
  • GS-14258: Display a tooltip showing the index hits count in the object drill down page of the Ops Manager UI
  • GS-14225: Added support for scale up/down stateful pu without HA
  • GS-14247: Set logger level using environment variable or system property
  • GS-14246: Set metrics xml config file via GS_METRICS_CONFIG environment variable
  • GS-14245: Set metric sampler using environment variable or system property
  • GS-14205: Upgrade Oshi to 5.2.5
  • GS-14239: Change default pu memory to 512mb and managers default to 1024mb on ElasticGrid
  • GS-14236: Fix text overflow in GSCTL output to display all details including the token

Resolved Issues

    GS-14284: ElasticGrid - undeploy of a failed deployment leaks resources and causes error on redeploy
  • GS-14280: NullPointerException when failing to initialize connection to HSQLDB
  • GS-14278: ElasticGrid - scale out may hang when adding more than one partition with insufficient resources
  • GS-14279: ElasticGrid - node remove command may terminate nodes without draining them when removing multiple nodes
  • GS-14252: ElasticGrid - create cluster may fail when user-provided VPC/SG/subnet is in use
  • GS-14265: CPU utilization not consistently reported across platforms
  • GS-14261: Stateful blueprints fail to compile using Java 11 due to missing javax.annotation dependency
  • GS-14243: ElasticGrid - Creating AWS cluster using user-provided security group may fail when the inbound rules contain a rule for the client machine IP
  • GS-14074: After upgrading to 15 version, classNotFound exception due to usage of symbolic links
  • GS-14238: Retry policy used to connect a client to ZooKeeper elapses prematurely
  • GS-14223: Space remains in stopped state after network reconnection
  • GS-14257: Ops Manager UI displays an empty index
  • GS-14234: NullPointerException while running Explain Plan for Select Query that has id in Where clause
  • GS-14256: Change log level of SQLTransientConnectionException from SEVERE to WARNING
  • GS-14206: Oshi cause permanent WMI requests from XAP processes that are leading to a high CPU consumption
  • GS-14255: Ignore GS_PU_DYNAMIC_PARTITIONING environmental variable when deploying non-partitioned service
  • GS-14240: Create command might fail when using auto-generated subnet because of wrong availability zone choice
  • GS-14241: Grafana got 502 error in ElasticGrid caused by DNS resolution
  • GS-14080: Can't change port and IP in WEB UI
  • GS-14226: Change default disk size in ElasticGrid AWS
  • GS-14233: On Space shutdown, close ZooKeeper client's connection state listener
  • GS-14216: ElasticGrid support for Java 11 and later
  • GS-14228: After gsm restarted, exception [java.sql.SQLException: statement is closed] thrown for gsc
  • GS-14232: 'gsctl node add' command fails if a wrong component name was provided

Known Issues

For client version 14.0 or older, there is a possibility that the redo log will be corrupted and not available for system recovery.

This can only happen if all of the following conditions are true:

  • The client system is version 14.0 or older

  • AND the server-side system is a later release of 14.2 or higher

  • AND the old client did a Change operation.

  • AND the redo log exceeds RAM capacity and goes to the hard drive,.

15.5.0

Features and Enhancements

  • GS-14178: Service horizontal scale in Elastic Grid
  • GS-14177: Service vertical scale in Elastic Grid
  • GS-14170: Deploy/Undeploy Processing Units in ElasticGrid
  • GS-14199: Enhance InsightEdge JDBC driver to properly report catalog support
  • GS-14166: Add ability to deploy Processing Unit using the Ops Manager
  • GS-14180: Add ability to undeploy Processing Units using the Ops Manager
  • GS-14182: Add ability to run SQL Query with explain plan using the Ops Manager
  • GS-14157: Simplify Spring security integration
  • GS-14189: Add MongoDB as a built-in service for ElasticGrid
  • GS-14188: Support for @Repeatable meta-annotation
  • GS-14168: Improve performance of storing reported metrics to hsqldb
  • GS-14165: Support Compound Index from data connectivity
  • GS-14154: New REST API for vertical scaling of a service for ElasticGrid and Kubernetes
  • GS-14160: On-demand service scale with multiple partitions using Ops Manager with Kubernetes
  • GS-14163: View log of Service instance in Ops Manager
  • GS-14079: Dynamically scale in/out a Space partition
  • GS-14169: GSCTL as REST Service
  • GS-14175: Add new CLI command for vertical scaling of a service for ElasticGrid and Kubernetes
  • GS-14167: Set index type and edit existing index in data connectivity view
  • GS-14114: Volume support for services persistence for ElasticGrid
  • GS-14100: Heap size report in Ops Manager
  • GS-14131: On-demand single partition vertical scale in Ops Manager for ElasticGrid and Kubernetes
  • GS-14143: Enhance data connectivity to support tables with multiple column primary keys
  • GS-14161: Custom roles for in-memory Spring security configuration
  • GS-14155: Service To service continuous data transfer
  • GS-14159: Allow configuring Jetty's request header size
  • GS-14156: Session cookies for GigaSpaces web-based tools are now unique
  • GS-14141: Enhance mirror service with Apache Kafka
  • GS-14148: Add option for auto revert on vertical scale in Kubernetes
  • GS-14151: Start ElasticGrid cluster with security
  • GS-14130: Show index hits in Ops Manager
  • GS-14123: TDVT – Update dialect, connection string and utils for Tableau JDBC connector
  • GS-14122: Start ElasticGrid cluster with TLS enabled
  • GS-14139: Secure Ops Manager with authentication
  • GS-14133: Allow to predefine data sources for Ops Manager
  • GS-14132: Automatically select optimal iterator type for embedded/remote space
  • GS-14125: Report and display data type index hits in Grafana
  • GS-14105: Allow duplicate UIDs in single writeMultiple on InsightEdge w/RocksDB
  • GS-14126: Enhance QueryCache to log a warning when cache is full
  • GS-14111: Upgrade Nomad from 0.10.1 to 0.11.2 and Consul from 1.6.1 to 1.7.3
  • GS-14104: Adding support for IAM role binding to an EC2 instance
  • GS-14085: Expose instances log in Ops Manager
  • GS-14077: Improved performance using getLastStatistics instead of getStatistics
  • GS-14119: Optimize shortest-index selection to speed up query execution
  • GS-14214: Data-connectivity support for Oracle and PostgreSQL

Resolved Issues

  • GS-14088: Add support in data-connectivity for database tables with an auto-generated ID column
  • GS-14179: Error creating bean specified in LDAP Spring security configuration file
  • GS-14145: Override metrics DB port using com.gs.ui.metrics.db.port system property
  • GS-14135: Select shortest index for known and unknown sizes
  • GS-14144: Explain plan shows unusable index as selected for matching
  • GS-14121: Configure amount of time to block on a read call from socket
  • GS-14117: The 'pu run' and 'space run' CLI commands fail when Java 11 is used
  • GS-14112: Space Iterator of type CURSOR returns empty results with super type queries
  • GS-14109: After a network reconnect a pending instance might be discarded and not monitored for liveness
  • GS-14096: Failing validation phase couldn't destroy the cluster and its dynamic resources on AWS mode
  • GS-14091: Destroy terminates all instances related to the vpc provided by the user
  • GS-14083: When there is a dash in the space name, the Object type drill down does not work

Known Issues

  • GS-14215: Edge case when the deployment of a service failed and the job will remain in Nomad
  • GS-14206: Oshi cause permanent WMI requests from XAP processes that are leading to a high CPU consumption
  • GS-14206: Tableau 2020.02 (or later) support requires disabling custom load.

For client version 14.0 or older, there is a possibility that the redo log will be corrupted and not available for system recovery.

This can only happen if all of the following conditions are true:

  • The client system is version 14.0 or older

  • AND the server-side system is a later release of 14.2 or higher

  • AND the old client did a Change operation.

  • AND the redo log exceeds RAM capacity and goes to the hard drive,.

 

The complete list of changes is also available in JiraJira.

The complete list of changes is also available in JiraJira.

The complete list of changes is also available in JiraJiraJira.