Changelog
This section lists the changes that were made to GigaSpaces products for 15.2.
16.4
Features and Enhancements
- GS-14979: Upgrade tierStorage jdbc package to avoid security vulnerability
- GS-14902: Flush redolog to disk in a shutdown if redolog was not cleared
Resolved Issues
- GS-14980: Upgrade SnakeYaml due to security vulnerability
- GS-14943: Upgrade roksdb to the latest version (8.1.1)
- GS-14955: Spring framework cve
- GS-14964: Executing a query when the match is done on a BigDecimal fails
- GS-14973: SpaceDeck not responsive moving between tabs when space include large number of types & data
- GS-14962: Upgrade spring to latest version possible with product java that avoid security vulnerabilities
- GS-14947: After upgrading to 16.2 -IllegalArgumentException in readByIds from local cache when only one ID is included and routing same as id
- GS-14951: BigDecimal comparison failing due to scientific notation scale value
- GS-14952: Recovery of backup doesn't recover all operations in case intensive transactions are done while recovering
- GS-14945: Flush redolog to disk should flush code map even when there no packets to flush
16.3
Features and Enhancements
- GS-14552: Add support for using customer certificate for REST manager of jks format
- GS-14532: Add support for passing configurations to K8s pod pu properties & env variables as yaml
- GS-14836: Add support to add dynamic index in tiered storage, and allow to remove it before writing to tier
- GS-14919: Tiered storage configuration is missing data
- GS-14873: Zookeeper upgrade to (at least) 3.6.0 (vulnerability + integration)
Resolved Issues
- GS-14939: Duplicate results when query is performed under certain set of conditions
- GS-14899: Pipeline - Failed to "add table" when the DB2 table contains a unique Index but not PK
- GS-14914: DI waste RAM by converting SMALLINT to Integer instead of Short
- GS-14921: Drop type causes NPE in Ops-ui and space view not shown
- GS-14918: Tiered Storage recovery from database fails in case of criteria including multiple conditions
- GS-14733: Increased memory usage of MarshalOutputStream in CPeer/Writer
16.2.1
Resolved Issues
- GS-14006: Aggregate causes a NPE when type definition is missing in one of the partitions
- GS-14825: Object should not remain locked when related transaction throws exception in commit
- GS-14848: Unable to replicate to mirror due to regex pattern syntax exception after upgrade
- GS-14882: Memory leak and OOM due to incomplete AdminAPI Cleanup
- GS-14883: Upgrade Spring & Spring security to 5.3.22 and 5.6.2 or higher
- GS-14889: LUS memory consumption increases when using Spring Boot Space PU
Known Issues
- GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
- GS-14742: smart-externalizable classcastexception when PUs share a GSC
-
As explained in the Jiras, these issues can be addressed by specifying the parameter
-Dcom.gs.smart-externalizable.enabled=false
- GS-14893: Hibernate integration - fail to fetch eagerly collection with 5.6.7 hibernate version
16.2
Features and Enhancements
- GS-14756: Vulnerability in Netty version (4.1.65.Final)
- GS-14272: Experimental API to unregister type descriptor
- GS-14779: Validate CR8 stream JSON file by the "load configuration" button
- GS-14728: Enhance SpaceId to support multiple properties
- GS-14776: ManagerClusterInfo Initialization on Admin – improve mechanism to avoid incorrect initialization due to discovery events order
- GS-14758: Expose InfluxDB metrics via REST
- GS-14746: Add global atomic counter for Manager REST requests
- GS-14626: Add audit for secured service grid - Audit for operations that cause a change in the grid
- GS-14741: Support CEF log messages
- GS-14711: Enhance replication to replicate drop type to backup
- GS-14627: WEB-UI - Add audit information
- GS-14723: Set Zeppelin Jdbc Interpreter to run with v3 driver
- GS-14688: Java 17 support
- GS-14624: Add ability to support https connection to influxdb
- GS-14570: upgrade commons-compress to latest version 1.21
Resolved Issues
- GS-14885: OPS UI does not display in Tiered Storage configuration types registered with criteria, if Tiered Storage also configured in Space
- GS-14826: In OPS UI, criteria do not show in Space configuration when dynamically registering type with tier criteria
- GS-14887: Null pointer exception when trying to evict objects in Tiered Storage space
- GS-14872: Redo log using SQLite fails to deserialize operations when involved objects contain an enum, or when serial number of a member field class is not the same as the space class
- GS-14857: Kubernetes – no support for installing more than one PU using an umbrella chart
- GS-14860: Clean up after uninstalling umbrella chart in Kubernetes
- GS-14867: Kubernetes – support anti-affinity between zones
- GS-14790: REST API – query Space data fails after failover
- GS-14800: Pipeline - Failure to retrieve pipelines caused Spaces and Services Overview to become unavailable in ops-ui
- GS-14805: Pipeline - the Consumer avoids existing messages if space is redeployed
- GS-14809: Pipeline - Consumer failed on null value when a value of a property which is part of compound id is null
- GS-14812: Pipeline - Consumer Fail to consume without logging any error
- GS-14443: Data loss due to instances disconnections from ZooKeeper due to long garbage collection
- GS-14744: Unwanted stdout logging in 16.1
- GS-14799: Primary failed to recover from SQLite due to Date ClassCastException, causing data loss
- GS-14776: ManagerClusterInfo Initialization on Admin – improve mechanism to avoid incorrect initialization due to discovery events order
- GS-14745: Remove unwanted stdout logging in DocumentProperties
- GS-14615: Chaining aggregators logic not working with GroupByAggregator in 15.8.1 version
Known Issues
- GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
- GS-14742: smart-externalizable classcastexception when PUs share a GSC
-
As explained in the Jiras, these issues can be addressed by specifying the parameter
-Dcom.gs.smart-externalizable.enabled=false
- GS-14893: Hibernate integration - fail to fetch eagerly collection with 5.6.7 hibernate version
16.1.1
Features and Enhancements
- GS-14184: Support Compound Space ID with Space Document
- GS-14354: Protect server from OOM caused by Client request
- GS-14734: Add placeholder for service account in Helm charts
- GS-14272: Experimental API to unregister type descriptor
Resolved Issues
- GS-14819: Hibernate security vulnerability - upgrade 3rd party jar to latest release each new release of GS version
- GS-14815: Data loss due to Redolog corruption caused by ConcurrentModificationException
- GS-14829: Incorrect "failed" and "discarded" metrics from mirror
- GS-14352: Redolog can't be read and will keep growing if redolog went to disk and change operations were done by 14.0 or older clients on 14.2 or newer server
- GS-14764: Failed to deploy Consumer in tiered storage space due to missing dynamic properties restriction in the type definition
- GS-14801: Consumer of CDC: Inability to resume initial load (full sync) in case of an error
- GS-14802: CDC consumer cannot resume stream activity to space after an error
- GS-14353: Add ability to recover corrupted redolog by skipping record that can't be deserialized
- GS-14786: Pipeline – need to add an option to control (override) the starting offset
- GS-14643: NPE when doing clear operation when clear is the first operation done by the client (regression starting 15.8)
- GS-14468: Can't use broadcast table if table extends any base class
- GS-14185: Support drops all Class's entries and all its templates from the space
Known Issues
- GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
- GS-14742: smart-externalizable classcastexception when PUs share a GSC
- GS-14893: Hibernate integration - fail to fetch eagerly collection with 5.6.7 hibernate version
As explained in the Jiras, these issues can be addressed by specifying the parameter -Dcom.gs.smart-externalizable.enabled=false
16.1
Features and Enhancements
- GS-14607: When securing webui using ssl, passwords should not be passed in using system properties
- GS-14606: Configuring ssl with webui keyManagerPassword should not be required
- GS-14566: Allow coding Instance SLA - currently class path issue
- GS-14586: Upgrade Netty to 4.1.66
- GS-14587: Upgrade H2 to 1.4.200
- GS-14581: Add property for Primary Key First
- GS-14573: Support SUM aggregation with scalar
- GS-14572: upgrade Avatica to 1.18.0
Resolved Issues
- GS-14615: Chaining aggregators logic not working with GroupByAggregator in 15.8.1 version
Known Issues
- GS-14868: Problems deploying WAN Gateway after upgrade to 16.x
- GS-14742: smart-externalizable classcastexception when PUs share a GSC
As explained in the Jiras, these issues can be addressed by specifying the parameter -Dcom.gs.smart-externalizable.enabled=false
16.0
Features and Enhancements
- GS-14520: Improve array creation for user-defined types using bytecode generation
- GS-14531: Remove user home dir usage
- GS-14519: Cursor iterator supports LRU space
- GS-14506: Improve performance of auto-generated default factory
- GS-14508: Add SmartExternalizable interface to optimize serialization
- GS-14515: Upgrade Spring Security to 5.5.0
- GS-14514: Upgrade Spring to 5.3.7
- GS-14510: Enable/disable transport version detection via environment variable or system property
- GS-14509: Improve platform version comparison
- GS-14517: Generate wrapper classes from the UI
- GS-14463: Kubernetes increase liveness probe values
- GS-14497: Add environment variables for common LRMI settings
- GS-14496: Change default LRMI port from 0 to 8200-8299
- GS-14492: Upgrade Jetty to 9.4.40
- GS-14487: Enhance Java version parsing to support early access builds
- GS-14486: Add user name to system report in beginning of log
- GS-14473: Upgrade hsqldb version from 2.3.2 to 2.5.2
- GS-14474: Support running Docker and Kubernetes as non-root user
- GS-14478: Improve Space clear with null template when Space contains broadcast table
- GS-14475: Support loading "com.gs.security.properties-file" from url
- GS-14476: Support loading "java.util.logging.config.file" from url
- GS-14477: Support loading "com.gigaspaces.metrics.config" from url
- GS-14429: Issue with deploying Manager to multiple namespace in K8s (GS-15.8)
- GS-14420: Upgrade Oshi to 5.5.0
- GS-14415: Match performance of read/takeByIds with a single Id to that of read/takeById API
- GS-14389: Move heap report to zookeeper
- GS-14391: Upgrade Spring Security to 5.4.2
- GS-14390: Upgrade Spring to 5.2.12
- GS-14387: End of Life - Sigar integration
Resolved Issues
- GS-14551: REST V2 - Fix REST-API for getting requests info
- GS-14540: Fail to start local view inside Kubernetes cluster
- GS-14539: java.lang.NumberFormatException: For input string: "∞"
- GS-14537: java.sql.SQLException: Statement is invalid while deleting rows from tables - hsqldb version must be changed back to 2.3.2
- GS-14518: ClassCastException thrown when select query with wrong date/time format executed on indexed date/time class variable
- GS-14479: Unable to change zookeeper clientPort
- GS-14465: Allow to configure security in Kubernetes
- GS-14458: First-app example missing slf4j dependency
- GS-14460: Concurrent modification bug in system task
- GS-14409: Can't connect to a secured space using Ops Manager, or to query data in the rest API
- GS-14421: Quiesce Mode during fail over is not resolved even after the curator client already reports RECONNECTED
- GS-14438: Default Cursor iterator does not support LRU space
- GS-14435: Default Cursor iterator does not support local view
- GS-14450: NPE running cursor iterator in DEBUG log level
- GS-14399: Upgrade from 14.5 to 15.x - ClusterInfo.getInstanceId() is wrong in some conditions
- GS-14442: "Templating dataTypeName" error in Grafana v7.4.1 when displaying Space Object Type Index Metrics
- GS-14442: "Templating dataTypeName" error in Grafana v7.4.1 when displaying Space Object Type Index Metrics
- GS-14427: Kubernetes operator - Pass LRMI properties to PU
- GS-14426: Kubernetes operator - Pass license to Kubernetes manager
- GS-14423: Replace null values with "N/A" to avoid write failure In Constructor OSVendorDetails caused by Oshi version not supporting MacOs version
- GS-14422: Block unauthorized features in REST and Ops-UI
- GS-14417: REST: Path variable with dot (.) is truncated in URL
- GS-14388: Upgrade from 12.3 to 15.5.1 log regression — unable to create log per PU using slf4j logger api and Log4j configuration
- GS-14404: Service Dump does not complete if an exception is thrown during operation
- GS-14406: Add scroll bar for data types and indexes table
- GS-14396: Query time shown in OpsManager is incorrect
- GS-14400: Scale operation on single Space should not be allowed
- GS-14401: Service card is green despite number of actual instances greater than planned
- GS-14395: Logging mismatch between context and log name
- GS-14398: Kubernetes scale up doesn't allow scale up/down right after first scale without changing the last values (OPS-UI)
- GS-14393: OPS-UI: NPE while writing to single space
- GS-14394: Deploying/undeploying a space succeeds but returns an operation timeout in the CLI
- GS-14392: Operation fails when scale up/down in Kubernetes is performed with same existing resource (Memory/CPU) values
- GS-14386: Zeppelin Notebook and Spark examples use the same case class
Known Issues
15.5.1
Features and Enhancements
- GS-14242: ElasticGrid - improve life cycle of processing units
- GS-14277: ElasticGrid - allow public access for AWS Cluster
- GS-14267: ElasticGrid - use AWS credentials from the client host for node add/remove commands
- GS-14263: ElasticGrid - Use --server=<node-ip> to communicate with cluster
- GS-14264: ElasticGrid - ask for confirmation when running destroy command
- GS-14251: Define liveness health check and cancel restarts in readiness health check for stateful service on ElasticGrid
- GS-14258: Display a tooltip showing the index hits count in the object drill down page of the Ops Manager UI
- GS-14225: Added support for scale up/down stateful pu without HA
- GS-14247: Set logger level using environment variable or system property
- GS-14246: Set metrics xml config file via GS_METRICS_CONFIG environment variable
- GS-14245: Set metric sampler using environment variable or system property
- GS-14205: Upgrade Oshi to 5.2.5
- GS-14239: Change default pu memory to 512mb and managers default to 1024mb on ElasticGrid
- GS-14236: Fix text overflow in GSCTL output to display all details including the token
Resolved Issues
- GS-14284: ElasticGrid - undeploy of a failed deployment leaks resources and causes error on redeploy
- GS-14280: NullPointerException when failing to initialize connection to HSQLDB
- GS-14278: ElasticGrid - scale out may hang when adding more than one partition with insufficient resources
- GS-14279: ElasticGrid - node remove command may terminate nodes without draining them when removing multiple nodes
- GS-14252: ElasticGrid - create cluster may fail when user-provided VPC/SG/subnet is in use
- GS-14265: CPU utilization not consistently reported across platforms
- GS-14261: Stateful blueprints fail to compile using Java 11 due to missing javax.annotation dependency
- GS-14243: ElasticGrid - Creating AWS cluster using user-provided security group may fail when the inbound rules contain a rule for the client machine IP
- GS-14074: After upgrading to 15 version, classNotFound exception due to usage of symbolic links
- GS-14238: Retry policy used to connect a client to ZooKeeper elapses prematurely
- GS-14223: Space remains in stopped state after network reconnection
- GS-14257: Ops Manager UI displays an empty index
- GS-14234: NullPointerException while running Explain Plan for Select Query that has id in Where clause
- GS-14256: Change log level of SQLTransientConnectionException from SEVERE to WARNING
- GS-14206: Oshi cause permanent WMI requests from XAP processes that are leading to a high CPU consumption
- GS-14255: Ignore GS_PU_DYNAMIC_PARTITIONING environmental variable when deploying non-partitioned service
- GS-14240: Create command might fail when using auto-generated subnet because of wrong availability zone choice
- GS-14241: Grafana got 502 error in ElasticGrid caused by DNS resolution
- GS-14080: Can't change port and IP in WEB UI
- GS-14226: Change default disk size in ElasticGrid AWS
- GS-14233: On Space shutdown, close ZooKeeper client's connection state listener
- GS-14216: ElasticGrid support for Java 11 and later
- GS-14228: After gsm restarted, exception [java.sql.SQLException: statement is closed] thrown for gsc
- GS-14232: 'gsctl node add' command fails if a wrong component name was provided
Known Issues
For client version 14.0 or older, there is a possibility that the redo log will be corrupted and not available for system recovery.
This can only happen if all of the following conditions are true:
-
The client system is version 14.0 or older
-
AND the server-side system is a later release of 14.2 or higher
-
AND the old client did a Change operation.
-
AND the redo log exceeds RAM capacity and goes to the hard drive,.
15.5.0
Features and Enhancements
- GS-14178: Service horizontal scale in Elastic Grid
- GS-14177: Service vertical scale in Elastic Grid
- GS-14170: Deploy/Undeploy Processing Units in ElasticGrid
- GS-14199: Enhance InsightEdge JDBC driver to properly report catalog support
- GS-14166: Add ability to deploy Processing Unit using the Ops Manager
- GS-14180: Add ability to undeploy Processing Units using the Ops Manager
- GS-14182: Add ability to run SQL Query with explain plan using the Ops Manager
- GS-14157: Simplify Spring security integration
- GS-14189: Add MongoDB as a built-in service for ElasticGrid
- GS-14188: Support for @Repeatable meta-annotation
- GS-14168: Improve performance of storing reported metrics to hsqldb
- GS-14165: Support Compound Index from data connectivity
- GS-14154: New REST API for vertical scaling of a service for ElasticGrid and Kubernetes
- GS-14160: On-demand service scale with multiple partitions using Ops Manager with Kubernetes
- GS-14163: View log of Service instance in Ops Manager
- GS-14079: Dynamically scale in/out a Space partition
- GS-14169: GSCTL as REST Service
- GS-14175: Add new CLI command for vertical scaling of a service for ElasticGrid and Kubernetes
- GS-14167: Set index type and edit existing index in data connectivity view
- GS-14114: Volume support for services persistence for ElasticGrid
- GS-14100: Heap size report in Ops Manager
- GS-14131: On-demand single partition vertical scale in Ops Manager for ElasticGrid and Kubernetes
- GS-14143: Enhance data connectivity to support tables with multiple column primary keys
- GS-14161: Custom roles for in-memory Spring security configuration
- GS-14155: Service To service continuous data transfer
- GS-14159: Allow configuring Jetty's request header size
- GS-14156: Session cookies for GigaSpaces web-based tools are now unique
- GS-14141: Enhance mirror service with Apache Kafka
- GS-14148: Add option for auto revert on vertical scale in Kubernetes
- GS-14151: Start ElasticGrid cluster with security
- GS-14130: Show index hits in Ops Manager
- GS-14123: TDVT – Update dialect, connection string and utils for Tableau JDBC connector
- GS-14122: Start ElasticGrid cluster with TLS enabled
- GS-14139: Secure Ops Manager with authentication
- GS-14133: Allow to predefine data sources for Ops Manager
- GS-14132: Automatically select optimal iterator type for embedded/remote space
- GS-14125: Report and display data type index hits in Grafana
- GS-14105: Allow duplicate UIDs in single writeMultiple on InsightEdge w/RocksDB
- GS-14126: Enhance QueryCache to log a warning when cache is full
- GS-14111: Upgrade Nomad from 0.10.1 to 0.11.2 and Consul from 1.6.1 to 1.7.3
- GS-14104: Adding support for IAM role binding to an EC2 instance
- GS-14095: Support helm 3
- GS-14081: ElasticGrid hybrid cluster support
- GS-14094: Upgrade Zookeeper version to 3.5.7
- GS-14085: Expose instances log in Ops Manager
- GS-14077: Improved performance using getLastStatistics instead of getStatistics
- GS-14119: Optimize shortest-index selection to speed up query execution
- GS-14214: Data-connectivity support for Oracle and PostgreSQL
Resolved Issues
- GS-14088: Add support in data-connectivity for database tables with an auto-generated ID column
- GS-14179: Error creating bean specified in LDAP Spring security configuration file
- GS-14145: Override metrics DB port using com.gs.ui.metrics.db.port system property
- GS-14135: Select shortest index for known and unknown sizes
- GS-14144: Explain plan shows unusable index as selected for matching
- GS-14121: Configure amount of time to block on a read call from socket
- GS-14117: The 'pu run' and 'space run' CLI commands fail when Java 11 is used
- GS-14112: Space Iterator of type CURSOR returns empty results with super type queries
- GS-14109: After a network reconnect a pending instance might be discarded and not monitored for liveness
- GS-14096: Failing validation phase couldn't destroy the cluster and its dynamic resources on AWS mode
- GS-14091: Destroy terminates all instances related to the vpc provided by the user
- GS-14083: When there is a dash in the space name, the Object type drill down does not work
Known Issues
- GS-14215: Edge case when the deployment of a service failed and the job will remain in Nomad
- GS-14206: Oshi cause permanent WMI requests from XAP processes that are leading to a high CPU consumption
- GS-14206: Tableau 2020.02 (or later) support requires disabling custom load.
For client version 14.0 or older, there is a possibility that the redo log will be corrupted and not available for system recovery.
This can only happen if all of the following conditions are true:
-
The client system is version 14.0 or older
-
AND the server-side system is a later release of 14.2 or higher
-
AND the old client did a Change operation.
-
AND the redo log exceeds RAM capacity and goes to the hard drive,.