3.2.0.0-RC1

    Release notes - hops - Version 3.2.0.0

Improvement

• [HOPS-1377] - Update to move code base to hadoop3
• [HOPS-1551] - User specific X.509 certificates for Hops TLS
• [HOPS-1568] - Add support for large XAttrs (>13500)
• [HOPS-1585] - replica under construction fix

Bug

• [HOPS-1390] - HDFS concat should keep srcs order Export
• [HOPS-1432] - ApplicationImpl.AppLogInitDoneTransition should save jwt to the state store
• [HOPS-1480] - DevRemoteCRLFetcher missing in 3.2.0.0
• [HOPS-1512] - Apply YARN-9205 to fix GPU support on hops-3.2.0.0
• [HOPS-1520] - TestEncryptionZones broken on branch 3
• [HOPS-1523] - TestEncryptionZonesWithKMS brocken on branch 3.2.0.0
• [HOPS-1546] - unchecked cast to INodeDirectory
• [HOPS-1558] - accept android handler from consul
• [HOPS-1559] - Updated security material are not propagated Container
• [HOPS-1561] - HopsX509Authenticator should not do a reverse DNS lookup since service discovery
• [HOPS-1571] - Fix hopsfs retry cache explosions
• [HOPS-1572] - Fix DB Access Exception in Lease Manager
• [HOPS-1573] - Fix garbage collection in Lease Paths
• [HOPS-1578] - Access storage exception on ACLs when calling setStoragePolicy
• [HOPS-1579] - SuperuserKeystoresLoader should use the login user to identify crypto material
• [HOPS-1580] - Leader election use bind address for http address
• [HOPS-1583] - Access storage exception on ACLs when calling delete

Task

• [HOPS-1560] - Use system's configured nameserver

Hops sub-tasks

• [HOPS-1378] - Move most of the codebase to hadoop 3.2.0
• [HOPS-1379] - Support for YARN TimelineService HBase tests
• [HOPS-1382] - Check ACLs in TestDistCpWithAcls
• [HOPS-1384] - Put back check invariants in Hadoop-client-modulres
• [HOPS-1385] - Support for YARN Quota
• [HOPS-1386] - Fix TestDistCpSystem
• [HOPS-1387] - Fix TestX509SecurityHandler.testApplicationSubmission
• [HOPS-1388] - Cleanup Dal and Dal-impl
• [HOPS-1391] - Fix TestGetBlocks
• [HOPS-1396] - Update documentation
• [HOPS-1399] - Fix dist profile
• [HOPS-1400] - Put back hadoop-client-minicluster
• [HOPS-1401] - update systemd scripts
• [HOPS-1405] - Fix hdfs scripts and var table

2.8.2.10.rc1

    Release notes - hops - Version 2.8.2.10

Bug

• [HOPS-1545] - apply HDFS-9625
• [HOPS-1547] - WebHDFS connection hungs when RM is colocated with DN
• [HOPS-1550] - IndividualBlockLock.announceBlockDoesNotExist should not use global blockId variable
• [HOPS-1553] - Fix NNThroughputBenchmark
• [HOPS-1554] - CountersQueue throw EmptyCountersQueueException under highload
• [HOPS-1561] - HopsX509Authenticator should not do a reverse DNS lookup since service discovery
• [HOPS-1562] - ACL mask modification failed due to ClassCastException
• [HOPS-1563] - Missing ACE lock in deprecated rename function
• [HOPS-1564] - Fix Inode File locking
• [HOPS-1572] - Fix DB Access Exception in Lease Manager

Hops sub-tasks

• [HOPS-1549] - Use Project's x.509 in WebHDFS for application requests

Improvement

• [HOPS-1552] - DataNodes discover NameNodes using Service Discovery
• [HOPS-1565] - Fixes in Mover tools to properly handle single datanode clusters
• [HOPS-1566] - Missing partition by for hdfs_file_provenance_xattrs_buffer

Task

• [HOPS-1560] - Use system's configured nameserver

2.8.2.9

    Release notes - hops - Version 2.8.2.9

Improvement

• [HOPS-1113] - FTIS on Inodes table during inverse path look
• [HOPS-1349] - improve parallel copy from local
• [HOPS-1351] - Make small files size configurable
• [HOPS-1369] - Need for more info when a transaction fail during the commit phase
• [HOPS-1392] - FS operations on inodes belonging to deleted users/groups are slow
• [HOPS-1415] - apply HDFS-6375
• [HOPS-1422] - apply HDFS-8102
• [HOPS-1425] - apply HDFS-8100
• [HOPS-1426] - apply HDFS-8103
• [HOPS-1427] - apply MAPREDUCE-5899
• [HOPS-1435] - apply HDFS-8084
• [HOPS-1436] - apply HDFS-7933
• [HOPS-1437] - apply HDFS-8083
• [HOPS-1438] - apply HDFS-3995
• [HOPS-1440] - apply HDFS-8117
• [HOPS-1442] - apply HADOOP-8469
• [HOPS-1444] - apply HDFS-6492
• [HOPS-1447] - apply HDFS-8082
• [HOPS-1450] - apply HDFS-8165
• [HOPS-1452] - apply HDFS-7863
• [HOPS-1454] - apply HDFS-4491
• [HOPS-1462] - apply HDFS-8169
• [HOPS-1463] - apply HADOOP-10771
• [HOPS-1464] - apply HDFS-6603
• [HOPS-1469] - apply HDFS-7242
• [HOPS-1478] - apply HDFS-8133
• [HOPS-1483] - Track changes on the metadaEnabled directory
• [HOPS-1484] - apply HDFS-8185
• [HOPS-1488] - apply HDFS-8215
• [HOPS-1499] - apply HDFS-8204
• [HOPS-1500] - apply HDFS-8280
• [HOPS-1506] - apply HDFS-8218
• [HOPS-1507] - apply HDFS-8052
• [HOPS-1508] - apply HDFS-8283
• [HOPS-1537] - fixing hdfs force format that fail because truncate on tables with FK is not supported
• [HOPS-1539] - Bump NDB version to 7.6.12
• [HOPS-1541] - Tracking file changes - provenance

New Feature

• [HOPS-1448] - apply HDFS-7891
• [HOPS-1501] - add encryption at rest feature
• [HOPS-1534] - Change default hdfs prefix to hopsfs

Bug

• [HOPS-1366] - 3 configurations for the same thing
• [HOPS-1370] - NPE when RM is recovering with Yarn JWT enabled and app is running
• [HOPS-1371] - Remove getRemovedForced and forceRemove from BaseEntityContext
• [HOPS-1374] - Fixing storage policy in Hdfsstatus for small files
• [HOPS-1375] - remove test.log from hdfs
• [HOPS-1376] - deadlock in BPServiceActor.offerService
• [HOPS-1389] - NullPointerException when running FSCK
• [HOPS-1390] - HDFS concat should keep srcs order Export
• [HOPS-1395] - Put back limit on number of elements in folders
• [HOPS-1402] - Delete sics-db-model.mwb from dal resources
• [HOPS-1416] - apply HDFS-6464
• [HOPS-1424] - apply HDFS-8081
• [HOPS-1433] - init certificateLocalizationService before containerManager in NodeManager
• [HOPS-1434] - apply HDFS-6395
• [HOPS-1439] - HopsSSLSocketFactory should fallback to default ssl-client configuration if file exists but it's not readable
• [HOPS-1441] - apply HDFS-6666
• [HOPS-1443] - apply HDFS-8055
• [HOPS-1445] - apply HDFS-8149
• [HOPS-1446] - apply HDFS-8135
• [HOPS-1449] - apply HDFS-8153
• [HOPS-1451] - Use varbinary for xattrs value
• [HOPS-1453] - apply HDFS-8043
• [HOPS-1455] - apply HADOOP-9485
• [HOPS-1456] - apply HDFS-8158
• [HOPS-1457] - apply HADOOP-9418
• [HOPS-1458] - apply HADOOP-10017
• [HOPS-1460] - apply HDFS-6841
• [HOPS-1461] - apply HDFS-6556
• [HOPS-1465] - apply HDFS-6422
• [HOPS-1467] - apply HDFS-6778
• [HOPS-1471] - apply HDFS-8173
• [HOPS-1472] - apply HDFS-8179
• [HOPS-1474] - apply HDFS-7993
• [HOPS-1475] - apply HDFS-8163
• [HOPS-1476] - HdfsStorageFactory.resetDALInitialized should reset IDsGeneratorFactory
• [HOPS-1479] - wrong comparison in RMNodeApplication.equal
• [HOPS-1482] - Security material incorrectly revoked when application failed but there are more attempts
• [

2.8.2.9.rc1

    Release notes - hops - Version 2.8.2.9

Bug

• [HOPS-1366] - 3 configurations for the same thing
• [HOPS-1370] - NPE when RM is recovering with Yarn JWT enabled and app is running
• [HOPS-1371] - Remove getRemovedForced and forceRemove from BaseEntityContext
• [HOPS-1374] - Fixing storage policy in Hdfsstatus for small files
• [HOPS-1375] - remove test.log from hdfs
• [HOPS-1376] - deadlock in BPServiceActor.offerService
• [HOPS-1389] - NullPointerException when running FSCK
• [HOPS-1390] - HDFS concat should keep srcs order Export
• [HOPS-1395] - Put back limit on number of elements in folders
• [HOPS-1402] - Delete sics-db-model.mwb from dal resources
• [HOPS-1416] - apply HDFS-6464
• [HOPS-1424] - apply HDFS-8081
• [HOPS-1433] - init certificateLocalizationService before containerManager in NodeManager
• [HOPS-1434] - apply HDFS-6395
• [HOPS-1439] - HopsSSLSocketFactory should fallback to default ssl-client configuration if file exists but it's not readable
• [HOPS-1441] - apply HDFS-6666
• [HOPS-1443] - apply HDFS-8055
• [HOPS-1445] - apply HDFS-8149
• [HOPS-1446] - apply HDFS-8135
• [HOPS-1449] - apply HDFS-8153
• [HOPS-1451] - Use varbinary for xattrs value
• [HOPS-1453] - apply HDFS-8043
• [HOPS-1455] - apply HADOOP-9485
• [HOPS-1456] - apply HDFS-8158
• [HOPS-1457] - apply HADOOP-9418
• [HOPS-1458] - apply HADOOP-10017
• [HOPS-1460] - apply HDFS-6841
• [HOPS-1461] - apply HDFS-6556
• [HOPS-1465] - apply HDFS-6422
• [HOPS-1467] - apply HDFS-6778
• [HOPS-1471] - apply HDFS-8173
• [HOPS-1472] - apply HDFS-8179
• [HOPS-1474] - apply HDFS-7993
• [HOPS-1475] - apply HDFS-8163
• [HOPS-1476] - HdfsStorageFactory.resetDALInitialized should reset IDsGeneratorFactory
• [HOPS-1479] - wrong comparison in RMNodeApplication.equal
• [HOPS-1482] - Security material incorrectly revoked when application failed but there are more attempts
• [HOPS-1485] - apply HDFS-5570
• [HOPS-1486] - apply HDFS-4448
• [HOPS-1487] - apply HDFS-8147
• [HOPS-1489] - apply HDFS-8070
• [HOPS-1490] - apply HDFS-8217
• [HOPS-1491] - apply HDFS-8231
• [HOPS-1492] - apply HDFS-8191
• [HOPS-1493] - apply HDFS-8211
• [HOPS-1494] - apply HDFS-7673
• [HOPS-1495] - apply HDFS-8247
• [HOPS-1496] - apply HDFS-8206
• [HOPS-1497] - apply HDFS-8205
• [HOPS-1498] - apply HDFS-8232
• [HOPS-1502] - merge HADOOP-15473
• [HOPS-1504] - apply HDFS-7931
• [HOPS-1505] - apply HDFS-8142
• [HOPS-1509] - apply HDFS-8269
• [HOPS-1510] - refactor NameNodeBlockTokenSecretManager
• [HOPS-1511] - apply HDFS-8300
• [HOPS-1513] - Cleanup bad coding in metadata-dal
• [HOPS-1514] - Cleanup bad coding in metadata-dal-impl-ndb
• [HOPS-1516] - The Namenode and Reousemanager should stop when the database is dead
• [HOPS-1517] - Replace clover by opensource version
• [HOPS-1518] - WebHDFS requires user's certificates in the DataNodes
• [HOPS-1519] - Don't call System.exit in yarn tests
• [HOPS-1521] - Possible vunerabilities in netty-all and jackson-databind
• [HOPS-1522] - bug in DBRMStateStore.checkAvailableResources overload the database
• [HOPS-1525] - Getting a file's checksum does not work on Hops TLS
• [HOPS-1528] - Several improvements for small files
• [HOPS-1531] - More tests for TestSmallFileCreation
• [HOPS-1532] - Refactor finalizeINodeFileUnderConstruction
• [HOPS-1535] - Bump jackson2.version from 2.9.10 to 2.10.1
• [HOPS-1536] - Make path to TrustStore, KeyStore and Password configurable.
• [HOPS-1542] - Set hdfs as main scheme and hopsfs as alternative
• [HOPS-1544] - PriceMultiplicatiorService should wait before to retry writing to the DB
• [HOPS-1545] - apply HDFS-9625
• [HOPS-1546] - unchecked cast to INodeDirectory
• [HOPS-1547] - WebHDFS connection hungs when RM is colocated with DN
• [HOPS-1562] - ...

2.8.2.10.rc0

    Release notes - hops - Version 2.8.2.10

Bug

• [HOPS-1545] - apply HDFS-9625
• [HOPS-1547] - WebHDFS connection hungs when RM is colocated with DN
• [HOPS-1550] - IndividualBlockLock.announceBlockDoesNotExist should not use global blockId variable
• [HOPS-1553] - Fix NNThroughputBenchmark
• [HOPS-1554] - CountersQueue throw EmptyCountersQueueException under highload
• [HOPS-1561] - HopsX509Authenticator should not do a reverse DNS lookup since service discovery
• [HOPS-1562] - ACL mask modification failed due to ClassCastException
• [HOPS-1563] - Missing ACE lock in deprecated rename function
• [HOPS-1564] - Fix Inode File locking

Hops sub-tasks

• [HOPS-1549] - Use Project's x.509 in WebHDFS for application requests

Improvement

• [HOPS-1552] - DataNodes discover NameNodes using Service Discovery
• [HOPS-1565] - Fixes in Mover tools to properly handle single datanode clusters
• [HOPS-1566] - Missing partition by for hdfs_file_provenance_xattrs_buffer

Task

• [HOPS-1560] - Use system's configured nameserver

2.8.2.8

    Release notes - hops - Version 2.8.2.8

Bug

• [HOPS-28] - hdfs dfs -put doesnt work with multiple NNs (but -copyFromLocal does)
• [HOPS-920] - BPOfferService.blockReport should call blockReportCompleted in a finnaly
• [HOPS-985] - apply HDFS-7394
• [HOPS-986] - apply HDFS-7399
• [HOPS-990] - apply HDFS-7406
• [HOPS-991] - apply HDFS-7225
• [HOPS-992] - apply HDFS-7374
• [HOPS-1002] - apply HDFS-4882
• [HOPS-1005] - apply HDFS-7303
• [HOPS-1007] - apply HDFS-7444
• [HOPS-1018] - apply HDFS-7472
• [HOPS-1025] - apply HDFS-7481
• [HOPS-1026] - apply HDFS-5578
• [HOPS-1028] - apply HDFS-7515
• [HOPS-1029] - apply HDFS-7497
• [HOPS-1030] - apply HDFS-7517
• [HOPS-1034] - apply HDFS-6425
• [HOPS-1038] - NPE During NN restart.
• [HOPS-1039] - A bug in FSNameSystem.addSafeBlocks() is overloading the database
• [HOPS-1040] - the CacheReplicationMonitor and ReplicationMonitor for block should not kill the namenode in case of StorageException.
• [HOPS-1043] - apply HDFS-7494
• [HOPS-1045] - Change log level for LockUpgradeException
• [HOPS-1046] - JVM optimisation remove error stack trace
• [HOPS-1047] - update ndb to 7.6.9
• [HOPS-1052] - apply HDFS-7431
• [HOPS-1053] - apply HDFS-7552
• [HOPS-1054] - apply HDFS-7443
• [HOPS-1061] - apply HDFS-7596
• [HOPS-1064] - apply HDFS-7533
• [HOPS-1065] - apply HDFS-5445
• [HOPS-1069] - apply HDFS-7457
• [HOPS-1074] - apply HDFS-7632
• [HOPS-1076] - apply HDFS-7637
• [HOPS-1077] - apply HDFS-7641
• [HOPS-1078] - apply HDFS-7610
• [HOPS-1079] - apply HDFS-3443
• [HOPS-1080] - apply HDFS-7496
• [HOPS-1081] - apply HDFS-7548
• [HOPS-1083] - apply HDFS-7575
• [HOPS-1084] - apply HDFS-7644
• [HOPS-1088] - apply HDFS-7659
• [HOPS-1089] - apply HDFS-7224
• [HOPS-1090] - apply HDFS-49
• [HOPS-1092] - apply HDFS-7566
• [HOPS-1093] - Fixing NPE in Lease Manager caused by HOPS-1031
• [HOPS-1094] - apply HDFS-7677
• [HOPS-1098] - apply HDFS-7696
• [HOPS-1099] - Change inode id to long in the scripts that create and drop disk data tables
• [HOPS-1100] - BRTrackingService.assignWork should be one transaction
• [HOPS-1101] - NN started after the cluster get out of safemode never initializeReplQueues
• [HOPS-1102] - Tuple did not exist in RertryCacheCleaner
• [HOPS-1106] - HDFS admin ui broken behind proxy
• [HOPS-1112] - Fix firstBlockReport check in processReport fn in BlockManager for Multi NN
• [HOPS-1117] - apply HDFS-7108
• [HOPS-1118] - Database query fails for large number of buckets per datanode
• [HOPS-1121] - Remove DB connect information from the log
• [HOPS-1122] - apply HDFS-7734
• [HOPS-1123] - apply HDFS-7719
• [HOPS-1124] - apply HDFS-7709
• [HOPS-1127] - apply HDFS-7698
• [HOPS-1128] - apply HDFS-7741
• [HOPS-1132] - apply HDFS-7647
• [HOPS-1133] - NormalUserCertLocServiceHopsSSLCheck should not throw an exception if AppId is null
• [HOPS-1134] - apply HDFS-7756
• [HOPS-1135] - apply HDFS-7744
• [HOPS-1136] - apply HDFS-7714
• [HOPS-1141] - apply HDFS-7736
• [HOPS-1145] - Use user's username when generating JWT instead of project specific username
• [HOPS-1149] - Acquire exclusive lock on fd when updating crypto material and remove IO from NM heartbeat
• [HOPS-1150] - Problems in Users&Groups cache invalidation leads to permission denied exception when a user belongs to multiple groups
• [HOPS-1151] - Reading all replicas for a bucket is a FTS.
• [HOPS-1155] - ClientCache invalidates running Client
• [HOPS-1159] - QuotaUpdateManager should not sleep when there is parent updates to apply
• [HOPS-1165] - apply HDFS-7721
• [HOPS-1166] - apply HDFS-7686
• [HOPS-1167] - apply HDFS-7778
• [HOPS-1170] - apply HDFS-7798
• [

2.8.2.9.rc0

    Release notes - hops - Version 2.8.2.9

Bug

• [HOPS-1366] - 3 configurations for the same thing
• [HOPS-1370] - NPE when RM is recovering with Yarn JWT enabled and app is running
• [HOPS-1371] - Remove getRemovedForced and forceRemove from BaseEntityContext
• [HOPS-1374] - Fixing storage policy in Hdfsstatus for small files
• [HOPS-1375] - remove test.log from hdfs
• [HOPS-1376] - deadlock in BPServiceActor.offerService
• [HOPS-1389] - NullPointerException when running FSCK
• [HOPS-1390] - HDFS concat should keep srcs order Export
• [HOPS-1395] - Put back limit on number of elements in folders
• [HOPS-1402] - Delete sics-db-model.mwb from dal resources
• [HOPS-1416] - apply HDFS-6464
• [HOPS-1424] - apply HDFS-8081
• [HOPS-1433] - init certificateLocalizationService before containerManager in NodeManager
• [HOPS-1434] - apply HDFS-6395
• [HOPS-1439] - HopsSSLSocketFactory should fallback to default ssl-client configuration if file exists but it's not readable
• [HOPS-1441] - apply HDFS-6666
• [HOPS-1443] - apply HDFS-8055
• [HOPS-1445] - apply HDFS-8149
• [HOPS-1446] - apply HDFS-8135
• [HOPS-1449] - apply HDFS-8153
• [HOPS-1451] - Use varbinary for xattrs value
• [HOPS-1453] - apply HDFS-8043
• [HOPS-1455] - apply HADOOP-9485
• [HOPS-1456] - apply HDFS-8158
• [HOPS-1457] - apply HADOOP-9418
• [HOPS-1458] - apply HADOOP-10017
• [HOPS-1460] - apply HDFS-6841
• [HOPS-1461] - apply HDFS-6556
• [HOPS-1465] - apply HDFS-6422
• [HOPS-1467] - apply HDFS-6778
• [HOPS-1471] - apply HDFS-8173
• [HOPS-1472] - apply HDFS-8179
• [HOPS-1474] - apply HDFS-7993
• [HOPS-1475] - apply HDFS-8163
• [HOPS-1476] - HdfsStorageFactory.resetDALInitialized should reset IDsGeneratorFactory
• [HOPS-1479] - wrong comparison in RMNodeApplication.equal
• [HOPS-1482] - Security material incorrectly revoked when application failed but there are more attempts
• [HOPS-1485] - apply HDFS-5570
• [HOPS-1486] - apply HDFS-4448
• [HOPS-1487] - apply HDFS-8147
• [HOPS-1489] - apply HDFS-8070
• [HOPS-1490] - apply HDFS-8217
• [HOPS-1491] - apply HDFS-8231
• [HOPS-1492] - apply HDFS-8191
• [HOPS-1493] - apply HDFS-8211
• [HOPS-1494] - apply HDFS-7673
• [HOPS-1495] - apply HDFS-8247
• [HOPS-1496] - apply HDFS-8206
• [HOPS-1497] - apply HDFS-8205
• [HOPS-1498] - apply HDFS-8232
• [HOPS-1502] - merge HADOOP-15473
• [HOPS-1504] - apply HDFS-7931
• [HOPS-1505] - apply HDFS-8142
• [HOPS-1509] - apply HDFS-8269
• [HOPS-1510] - refactor NameNodeBlockTokenSecretManager
• [HOPS-1511] - apply HDFS-8300
• [HOPS-1513] - Cleanup bad coding in metadata-dal
• [HOPS-1514] - Cleanup bad coding in metadata-dal-impl-ndb
• [HOPS-1516] - The Namenode and Reousemanager should stop when the database is dead
• [HOPS-1517] - Replace clover by opensource version
• [HOPS-1518] - WebHDFS requires user's certificates in the DataNodes
• [HOPS-1519] - Don't call System.exit in yarn tests
• [HOPS-1521] - Possible vunerabilities in netty-all and jackson-databind
• [HOPS-1522] - bug in DBRMStateStore.checkAvailableResources overload the database
• [HOPS-1525] - Getting a file's checksum does not work on Hops TLS
• [HOPS-1528] - Several improvements for small files
• [HOPS-1531] - More tests for TestSmallFileCreation
• [HOPS-1532] - Refactor finalizeINodeFileUnderConstruction
• [HOPS-1535] - Bump jackson2.version from 2.9.10 to 2.10.1
• [HOPS-1536] - Make path to TrustStore, KeyStore and Password configurable.
• [HOPS-1542] - Set hdfs as main scheme and hopsfs as alternative
• [HOPS-1544] - PriceMultiplicatiorService should wait before to retry writing to the DB

Improvement

• [HOPS-1113] - FTIS on Inodes table during inverse path look
• [HOPS-1349] - improve parallel copy from local
• [HOPS-1351] - Make small files size configurable
• [

2.8.2.8.rc1

    Release notes - hops - Version 2.8.2.8

Bug

• [HOPS-28] - hdfs dfs -put doesnt work with multiple NNs (but -copyFromLocal does)
• [HOPS-920] - BPOfferService.blockReport should call blockReportCompleted in a finnaly
• [HOPS-985] - apply HDFS-7394
• [HOPS-986] - apply HDFS-7399
• [HOPS-990] - apply HDFS-7406
• [HOPS-991] - apply HDFS-7225
• [HOPS-992] - apply HDFS-7374
• [HOPS-1002] - apply HDFS-4882
• [HOPS-1005] - apply HDFS-7303
• [HOPS-1007] - apply HDFS-7444
• [HOPS-1018] - apply HDFS-7472
• [HOPS-1025] - apply HDFS-7481
• [HOPS-1026] - apply HDFS-5578
• [HOPS-1028] - apply HDFS-7515
• [HOPS-1029] - apply HDFS-7497
• [HOPS-1030] - apply HDFS-7517
• [HOPS-1034] - apply HDFS-6425
• [HOPS-1038] - NPE During NN restart.
• [HOPS-1039] - A bug in FSNameSystem.addSafeBlocks() is overloading the database
• [HOPS-1040] - the CacheReplicationMonitor and ReplicationMonitor for block should not kill the namenode in case of StorageException.
• [HOPS-1043] - apply HDFS-7494
• [HOPS-1045] - Change log level for LockUpgradeException
• [HOPS-1046] - JVM optimisation remove error stack trace
• [HOPS-1047] - update ndb to 7.6.9
• [HOPS-1052] - apply HDFS-7431
• [HOPS-1053] - apply HDFS-7552
• [HOPS-1054] - apply HDFS-7443
• [HOPS-1061] - apply HDFS-7596
• [HOPS-1064] - apply HDFS-7533
• [HOPS-1065] - apply HDFS-5445
• [HOPS-1069] - apply HDFS-7457
• [HOPS-1074] - apply HDFS-7632
• [HOPS-1076] - apply HDFS-7637
• [HOPS-1077] - apply HDFS-7641
• [HOPS-1078] - apply HDFS-7610
• [HOPS-1079] - apply HDFS-3443
• [HOPS-1080] - apply HDFS-7496
• [HOPS-1081] - apply HDFS-7548
• [HOPS-1083] - apply HDFS-7575
• [HOPS-1084] - apply HDFS-7644
• [HOPS-1088] - apply HDFS-7659
• [HOPS-1089] - apply HDFS-7224
• [HOPS-1090] - apply HDFS-49
• [HOPS-1092] - apply HDFS-7566
• [HOPS-1093] - Fixing NPE in Lease Manager caused by HOPS-1031
• [HOPS-1094] - apply HDFS-7677
• [HOPS-1098] - apply HDFS-7696
• [HOPS-1099] - Change inode id to long in the scripts that create and drop disk data tables
• [HOPS-1100] - BRTrackingService.assignWork should be one transaction
• [HOPS-1101] - NN started after the cluster get out of safemode never initializeReplQueues
• [HOPS-1102] - Tuple did not exist in RertryCacheCleaner
• [HOPS-1106] - HDFS admin ui broken behind proxy
• [HOPS-1112] - Fix firstBlockReport check in processReport fn in BlockManager for Multi NN
• [HOPS-1117] - apply HDFS-7108
• [HOPS-1118] - Database query fails for large number of buckets per datanode
• [HOPS-1121] - Remove DB connect information from the log
• [HOPS-1122] - apply HDFS-7734
• [HOPS-1123] - apply HDFS-7719
• [HOPS-1124] - apply HDFS-7709
• [HOPS-1127] - apply HDFS-7698
• [HOPS-1128] - apply HDFS-7741
• [HOPS-1132] - apply HDFS-7647
• [HOPS-1133] - NormalUserCertLocServiceHopsSSLCheck should not throw an exception if AppId is null
• [HOPS-1134] - apply HDFS-7756
• [HOPS-1135] - apply HDFS-7744
• [HOPS-1136] - apply HDFS-7714
• [HOPS-1141] - apply HDFS-7736
• [HOPS-1145] - Use user's username when generating JWT instead of project specific username
• [HOPS-1149] - Acquire exclusive lock on fd when updating crypto material and remove IO from NM heartbeat
• [HOPS-1150] - Problems in Users&Groups cache invalidation leads to permission denied exception when a user belongs to multiple groups
• [HOPS-1151] - Reading all replicas for a bucket is a FTS.
• [HOPS-1155] - ClientCache invalidates running Client
• [HOPS-1159] - QuotaUpdateManager should not sleep when there is parent updates to apply
• [HOPS-1165] - apply HDFS-7721
• [HOPS-1166] - apply HDFS-7686
• [HOPS-1167] - apply HDFS-7778
• [HOPS-1170] - apply HDFS-7798
• [

2.8.2.8.rc0

    Release notes - hops - Version 2.8.2.8

Bug

• [HOPS-28] - hdfs dfs -put doesnt work with multiple NNs (but -copyFromLocal does)
• [HOPS-920] - BPOfferService.blockReport should call blockReportCompleted in a finnaly
• [HOPS-985] - apply HDFS-7394
• [HOPS-986] - apply HDFS-7399
• [HOPS-990] - apply HDFS-7406
• [HOPS-991] - apply HDFS-7225
• [HOPS-992] - apply HDFS-7374
• [HOPS-1002] - apply HDFS-4882
• [HOPS-1005] - apply HDFS-7303
• [HOPS-1007] - apply HDFS-7444
• [HOPS-1018] - apply HDFS-7472
• [HOPS-1025] - apply HDFS-7481
• [HOPS-1026] - apply HDFS-5578
• [HOPS-1028] - apply HDFS-7515
• [HOPS-1029] - apply HDFS-7497
• [HOPS-1030] - apply HDFS-7517
• [HOPS-1034] - apply HDFS-6425
• [HOPS-1038] - NPE During NN restart.
• [HOPS-1039] - A bug in FSNameSystem.addSafeBlocks() is overloading the database
• [HOPS-1040] - the CacheReplicationMonitor and ReplicationMonitor for block should not kill the namenode in case of StorageException.
• [HOPS-1043] - apply HDFS-7494
• [HOPS-1045] - Change log level for LockUpgradeException
• [HOPS-1046] - JVM optimisation remove error stack trace
• [HOPS-1047] - update ndb to 7.6.9
• [HOPS-1052] - apply HDFS-7431
• [HOPS-1053] - apply HDFS-7552
• [HOPS-1054] - apply HDFS-7443
• [HOPS-1061] - apply HDFS-7596
• [HOPS-1064] - apply HDFS-7533
• [HOPS-1065] - apply HDFS-5445
• [HOPS-1069] - apply HDFS-7457
• [HOPS-1074] - apply HDFS-7632
• [HOPS-1076] - apply HDFS-7637
• [HOPS-1077] - apply HDFS-7641
• [HOPS-1078] - apply HDFS-7610
• [HOPS-1079] - apply HDFS-3443
• [HOPS-1080] - apply HDFS-7496
• [HOPS-1081] - apply HDFS-7548
• [HOPS-1083] - apply HDFS-7575
• [HOPS-1084] - apply HDFS-7644
• [HOPS-1088] - apply HDFS-7659
• [HOPS-1089] - apply HDFS-7224
• [HOPS-1090] - apply HDFS-49
• [HOPS-1092] - apply HDFS-7566
• [HOPS-1093] - Fixing NPE in Lease Manager caused by HOPS-1031
• [HOPS-1094] - apply HDFS-7677
• [HOPS-1098] - apply HDFS-7696
• [HOPS-1099] - Change inode id to long in the scripts that create and drop disk data tables
• [HOPS-1100] - BRTrackingService.assignWork should be one transaction
• [HOPS-1101] - NN started after the cluster get out of safemode never initializeReplQueues
• [HOPS-1102] - Tuple did not exist in RertryCacheCleaner
• [HOPS-1106] - HDFS admin ui broken behind proxy
• [HOPS-1112] - Fix firstBlockReport check in processReport fn in BlockManager for Multi NN
• [HOPS-1117] - apply HDFS-7108
• [HOPS-1118] - Database query fails for large number of buckets per datanode
• [HOPS-1121] - Remove DB connect information from the log
• [HOPS-1122] - apply HDFS-7734
• [HOPS-1123] - apply HDFS-7719
• [HOPS-1124] - apply HDFS-7709
• [HOPS-1127] - apply HDFS-7698
• [HOPS-1128] - apply HDFS-7741
• [HOPS-1132] - apply HDFS-7647
• [HOPS-1133] - NormalUserCertLocServiceHopsSSLCheck should not throw an exception if AppId is null
• [HOPS-1134] - apply HDFS-7756
• [HOPS-1135] - apply HDFS-7744
• [HOPS-1136] - apply HDFS-7714
• [HOPS-1141] - apply HDFS-7736
• [HOPS-1145] - Use user's username when generating JWT instead of project specific username
• [HOPS-1149] - Acquire exclusive lock on fd when updating crypto material and remove IO from NM heartbeat
• [HOPS-1150] - Problems in Users&Groups cache invalidation leads to permission denied exception when a user belongs to multiple groups
• [HOPS-1151] - Reading all replicas for a bucket is a FTS.
• [HOPS-1155] - ClientCache invalidates running Client
• [HOPS-1159] - QuotaUpdateManager should not sleep when there is parent updates to apply
• [HOPS-1165] - apply HDFS-7721
• [HOPS-1166] - apply HDFS-7686
• [HOPS-1167] - apply HDFS-7778
• [HOPS-1170] - apply HDFS-7798
• [

2.8.2.7

    Release notes - hops - Version 2.8.2.7

Bug

• [HOPS-132] - TestBlockReportLoadBalancing2 often time out
• [HOPS-829] - apply HDFS-5723
• [HOPS-830] - apply HDFS-5185
• [HOPS-831] - apply HDFS-6790
• [HOPS-832] - apply HDFS-6517
• [HOPS-833] - apply HDFS-6791
• [HOPS-841] - apply HDFS-6823
• [HOPS-842] - Writing small files slow down when the disk tables in the database are full
• [HOPS-843] - apply HDFS-6830
• [HOPS-845] - apply HDFS-6567
• [HOPS-846] - SSLEngine of RPC Server does not chunk the response if it is too big
• [HOPS-848] - apply HDFS-6783
• [HOPS-849] - apply HDFS-6825
• [HOPS-850] - apply HDFS-6188
• [HOPS-851] - apply HDFS-6569
• [HOPS-853] - apply HDFS-6247
• [HOPS-854] - apply HDFS-6870
• [HOPS-858] - apply HDFS-4852
• [HOPS-865] - apply HDFS-6902
• [HOPS-867] - Fixing string equality
• [HOPS-870] - apply HDFS-6972
• [HOPS-873] - apply HDFS-6831
• [HOPS-874] - apply HDFS-6979
• [HOPS-875] - apply HDFS-6862
• [HOPS-876] - apply HDFS-6898
• [HOPS-878] - apply HDFS-7005
• [HOPS-881] - Fix potential null pointer in INodeDalAdaptor, QuotaUpdateContext, INodeLock and FSNamesystem
• [HOPS-882] - Handle null values for users and groups in protobuff and fix potential null pointer exceptions
• [HOPS-885] - apply HDFS-6981
• [HOPS-886] - apply HDFS-6776
• [HOPS-887] - apply HDFS-7045
• [HOPS-888] - apply HDFS-7051
• [HOPS-889] - apply HDFS-6965
• [HOPS-890] - we need to update IntVariable to LongVariable
• [HOPS-891] - Potential NullPointers in FSNamesystem.getAdditionalDatanode
• [HOPS-893] - apply HDFS-6799
• [HOPS-895] - apply HDFS-6840
• [HOPS-896] - apply HDFS-6948
• [HOPS-897] - apply HDFS-7065
• [HOPS-898] - apply HDFS-7073
• [HOPS-899] - apply HDFS-7107
• [HOPS-900] - apply HDFS-7109
• [HOPS-901] - apply HDFS-7110
• [HOPS-902] - apply HDFS-7106
• [HOPS-903] - apply HDFS-7130
• [HOPS-904] - apply HDFS-6534
• [HOPS-907] - apply HDFS-7127
• [HOPS-911] - apply HDFS-6664
• [HOPS-912] - apply HDFS-7156
• [HOPS-913] - apply HDFS-4165
• [HOPS-914] - apply HDFS-7104
• [HOPS-915] - apply HDFS-7122
• [HOPS-916] - apply HDFS-6779
• [HOPS-917] - apply HDFS-7172
• [HOPS-918] - apply HDFS-7178
• [HOPS-919] - apply HDFS-7162
• [HOPS-920] - BPOfferService.blockReport should call blockReportCompleted in a finnaly
• [HOPS-922] - apply HDFS-6995
• [HOPS-923] - apply HDFS7-169
• [HOPS-925] - apply HDSF-7203
• [HOPS-926] - apply HDFS-7202
• [HOPS-927] - apply HDFS-7217
• [HOPS-930] - apply HDFS-6657
• [HOPS-931] - apply HDFS-6544
• [HOPS-932] - apply HDFS-7237
• [HOPS-934] - apply HDFS-7201
• [HOPS-938] - apply HDFS-7221
• [HOPS-943] - apply HDFS-7232
• [HOPS-944] - apply HDFS-7258
• [HOPS-946] - apply HDFS-6904
• [HOPS-947] - apply HDFS-6538
• [HOPS-949] - apply HDFS-7282
• [HOPS-954] - apply HDFS-7213
• [HOPS-955] - apply HDFS-7301
• [HOPS-956] - apply HDFS-7235
• [HOPS-957] - apply HDFS-7274
• [HOPS-958] - apply HDFS-7165
• [HOPS-963] - apply HDFS-7309
• [HOPS-964] - apply HDFS-7315
• [HOPS-965] - apply HDFS-6917
• [HOPS-969] - apply HDFS-7218
• [HOPS-972] - apply HDFS-7199
• [HOPS-973] - apply HDFS-7367
• [HOPS-977] - apply HDFS-7382
• [