merge apache/hbase #1
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
HBASE-26335 Minor improvements to IntegrationTestLoadCommonCrawl - Use BufferedMutator instead of Table. - Improve row key generator. - Improve retries and log levels. Signed-off-by: Viraj Jasani <[email protected]>
…s failure (#3736) Signed-off-by: Josh Elser <[email protected]> Signed-off-by: Nick Dimiduk <[email protected]> Signed-off-by: Sean Busbey <[email protected]>
Signed-off-by: Duo Zhang <[email protected]>
… file before relying on it. (#3590) Signed-off-by: Michael Stack <[email protected]> Signed-off-by: Duo Zhang <[email protected]>
#3693) Signed-off-by: Norbert Kalmar <[email protected]> Signed-off-by: Wellington Chevreuil <[email protected]>
…ease/mac-sshd-gpg-agent/Dockerfile` Signed-off-by: Sean Busbey <[email protected]>
…3648) * HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big Reduce the frequency of allocation failed traces by printing them preiodically (once per minute). Record the allocation failures in the Bucket Cache Stats and let the stat thread dump cumulative allocation failures alongside other traces it dumps. Also, this change adds trace for the Table name, Column Family and HFileName for the most recent allocation failure in last 1 minute. Signed-off-by: Anoop <[email protected]>
…tion when upgrading (#3746) Signed-off-by: Xiaolin Ha <[email protected]> Reviewed-by: GeorryHuang <[email protected]>
Signed-off-by: Duo Zhang <[email protected]>
) Signed-off-by: Yulin Niu <[email protected]>
Closes #3743 Signed-off-by: Pankaj <[email protected]> Signed-off-by: Tak Lon (Stephen) Wu <[email protected]> Signed-off-by: Wellington Chevreuil <[email protected]>
Signed-off-by: Yulin Niu <[email protected]>
…3759) Signed-off-by: Xiaolin Ha <[email protected]> Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Tak Lon (Stephen) Wu <[email protected]> Signed-off-by: Duo Zhang <[email protected]>
This avoids starvation when the archive directory is large and takes a long time to iterate through. Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Anoop Sam John <[email protected]> Signed-off-by: Pankaj <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]>
…3730) We get and retain Compressor instances in HFileBlockDefaultEncodingContext, and could in theory call Compressor#reinit when setting up the context, to update compression parameters like level and buffer size, but we do not plumb through the CompoundConfiguration from the Store into the encoding context. As a consequence we can only update codec parameters globally in system site conf files. Fine grained configurability is important for algorithms like ZStandard (ZSTD), which offers more than 20 compression levels, where at level 1 it is almost as fast as LZ4, and where at higher levels it utilizes computationally expensive techniques to rival LZMA at compression ratio but trades off significantly for reduced compresson throughput. The ZSTD level that should be set for a given column family or table will vary by use case. Signed-off-by: Viraj Jasani <[email protected]>
…3748) ZStandard supports initialization of compressors and decompressors with a precomputed dictionary, which can dramatically improve and speed up compression of tables with small values. For more details, please see The Case For Small Data Compression https://github.com/facebook/zstd#the-case-for-small-data-compression Signed-off-by: Duo Zhang <[email protected]>
…3744) Use a hybrid logical clock for timestamping entries. Using BufferedMutator without HLC was not good because we assign client timestamps, and the store loop is fast enough that on rare occasion two temporally adjacent URLs in the set of WARCs are equivalent and the timestamp does not advance, leading later to a rare false positive CORRUPT finding. While making changes, support direct S3N paths as input paths on the command line. Signed-off-by: Viraj Jasani <[email protected]>
…gion_mover (#3767) Signed-off-by: Andrew Purtell <[email protected]>
…it regions following a master failover (#3775) A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT. We need to check both regionState and regionInfo for split status. Signed-off-by: Viraj Jasani <[email protected]>
Signed-off-by: Josh Elser <[email protected]> Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Pankaj Kumar <[email protected]>
…3778) Signed-off-by: Yulin Niu <[email protected]>
…erly when we have a shortcut for trigger (#3710) Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Huaxiang Sun <[email protected]>
Signed-off-by: Viraj Jasani <[email protected]>
… CompactingMemStore (#3777) Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Rushabh Shah <[email protected]> Signed-off-by: Duo Zhang <[email protected]>
…f list (#3723) Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Huaxiang Sun <[email protected]>
Signed-off-by: Andrew Purtell <[email protected]>
…ce names Exposes process-specific tracing arguments for most of the commands that we can launch from `bin/hbase`. In addition to serving as an on/off flag, `HBASE_TRACE_OPTS` acts as the site-wide configuration setting. Additional variables are provided for each applicable command, giving operators fine-grain control over which processes participate in the tracing system, and to what degree. Signed-off-by: Tak Lon (Stephen) Wu <[email protected]> Signed-off-by: Josh Elser <[email protected]>
Signed-off-by: Duo Zhang <[email protected]>
…anager section in our ref guide (#3816) Signed-off-by: Yi Mei <[email protected]> Signed-off-by: GeorryHuang <[email protected]>
…release line (#3817) Signed-off-by: Yi Mei <[email protected]> Signed-off-by: GeorryHuang <[email protected]>
…anager section in our ref guide (#3818) Signed-off-by: GeorryHuang <[email protected]> Signed-off-by: Yulin Niu <[email protected]>
…3821) Signed-off-by: Peter Somogyi <[email protected]>
) Signed-off-by: Wei-Chiu Chuang <[email protected]>
Signed-off-by: Duo Zhang <[email protected]>
…led (#3819) Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Viraj Jasani <[email protected]>
…o INFO (#3820) Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Viraj Jasani <[email protected]>
Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Tak Lon (Stephen) Wu <[email protected]> Signed-off-by: Duo Zhang <[email protected]>
Signed-off-by: Duo Zhang <[email protected]>
…DOOP-17317 Signed-off-by: Sean Busbey <[email protected]> Signed-off-by: Wei-Chiu Chuang <[email protected]>
#3843) * HBASE-26450 Server configuration will overwrite HStore configuration After using shell command 'updateConfiguration'
…after using shell command 'update_config' (#3843) Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Baiqiang Zhao <[email protected]>
Signed-off-by: Duo Zhang <[email protected]> Signed-off-by: Tak Lon (Stephen) Wu <[email protected]>
…dInmemoryFlushSize (#3834) Signed-off-by: Duo Zhang <[email protected]>
…3838) Signed-off-by: Nick Dimiduk <[email protected]> Signed-off-by: Viraj Jasani <[email protected]> Signed-off-by: Xiaolin Ha <[email protected]>
…ption message, not the full stack trace (#3840) Signed-off-by: Anoop <[email protected]>
…#3841) Add the following stats for a given table: - 7. Total size of serialized cells of each CF. - 8. Total size of serialized cells of each qualifier. - 9. Total size of serialized cells across all rows. Signed-off-by: Viraj Jasani <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
25 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.