Skip to content

HBASE-29766 Support external client connection to kubernetized HBase cluster#7703

Open
meszibalu wants to merge 3 commits intoapache:masterfrom
meszibalu:hbase-29766
Open

HBASE-29766 Support external client connection to kubernetized HBase cluster#7703
meszibalu wants to merge 3 commits intoapache:masterfrom
meszibalu:hbase-29766

Conversation

@meszibalu
Copy link
Contributor

Added ExternalMappingCoprocessor which:

  • acts as ClientMeta, Master, Region co-proccessor.
  • accepts a mapping file in hbase.kubernetes.external.mapping configuration property.
  • this configuration file is watched and reloaded immediately upon a change.
  • replaces internal addresses to the external addresses using the mapping file in the following RPCs:
    • ClientMeta requests like master nodes, meta region server location, bootstrap nodes,
    • hbase:meta table gets/scans for info:sn, info:server columns,
    • getClusterMetrics (status command).

…cluster

Added ExternalMappingCoprocessor which:
* acts as ClientMeta, Master, Region co-proccessor.
* accepts a mapping file in hbase.kubernetes.external.mapping
  configuration property.
* this configuration file is watched and reloaded immediately upon a
  change.
* replaces internal addresses to the external addresses using the
  mapping file in the following RPCs:
  * ClientMeta requests like master nodes, meta region server location,
    bootstrap nodes,
  * hbase:meta table gets/scans for info:sn, info:server columns,
  * getClusterMetrics (status command).
@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 38s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+0 🆗 detsecrets 0m 0s detect-secrets was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 hbaseanti 0m 0s Patch does not have any anti-patterns.
_ master Compile Tests _
+0 🆗 mvndep 0m 12s Maven dependency ordering for branch
+1 💚 mvninstall 2m 37s master passed
+1 💚 compile 3m 22s master passed
+1 💚 checkstyle 1m 3s master passed
+1 💚 spotbugs 1m 55s master passed
+1 💚 spotless 0m 43s branch has no errors when running spotless:check.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 11s Maven dependency ordering for patch
+1 💚 mvninstall 2m 22s the patch passed
+1 💚 compile 3m 15s the patch passed
+1 💚 javac 3m 15s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
+1 💚 checkstyle 1m 1s the patch passed
-1 ❌ spotbugs 1m 25s /new-spotbugs-hbase-server.html hbase-server generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0)
+1 💚 hadoopcheck 9m 3s Patch does not cause any errors with Hadoop 3.3.6 3.4.1.
+1 💚 spotless 0m 36s patch has no errors when running spotless:check.
_ Other Tests _
+1 💚 asflicense 0m 16s The patch does not generate ASF License warnings.
35m 8s
Reason Tests
SpotBugs module:hbase-server
Possible null pointer dereference in org.apache.hadoop.hbase.kubernetes.ExternalMapping.processEvents() due to return value of called method Dereferenced at ExternalMapping.java:org.apache.hadoop.hbase.kubernetes.ExternalMapping.processEvents() due to return value of called method Dereferenced at ExternalMapping.java:[line 106]
Subsystem Report/Notes
Docker ClientAPI=1.53 ServerAPI=1.53 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7703/3/artifact/yetus-general-check/output/Dockerfile
GITHUB PR #7703
Optional Tests dupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
uname Linux a99a76cd7e10 6.14.0-1018-aws #18~24.04.1-Ubuntu SMP Mon Nov 24 19:46:27 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 7a9d024
Default Java Eclipse Adoptium-17.0.11+9
Max. process+thread count 87 (vs. ulimit of 30000)
modules C: hbase-client hbase-server U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7703/3/console
versions git=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 30s Docker mode activated.
-0 ⚠️ yetus 0m 4s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗 mvndep 0m 13s Maven dependency ordering for branch
+1 💚 mvninstall 3m 15s master passed
+1 💚 compile 1m 19s master passed
+1 💚 javadoc 0m 48s master passed
+1 💚 shadedjars 5m 47s branch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 14s Maven dependency ordering for patch
+1 💚 mvninstall 2m 57s the patch passed
+1 💚 compile 1m 20s the patch passed
+1 💚 javac 1m 20s the patch passed
+1 💚 javadoc 0m 45s the patch passed
+1 💚 shadedjars 5m 40s patch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚 unit 1m 28s hbase-client in the patch passed.
+1 💚 unit 229m 1s hbase-server in the patch passed.
258m 49s
Subsystem Report/Notes
Docker ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7703/3/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR #7703
Optional Tests javac javadoc unit compile shadedjars
uname Linux 9a228825628d 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / 7a9d024
Default Java Eclipse Adoptium-17.0.11+9
Test Results https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7703/3/testReport/
Max. process+thread count 4697 (vs. ulimit of 30000)
modules C: hbase-client hbase-server U: .
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7703/3/console
versions git=2.34.1 maven=3.9.8
Powered by Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants