Renamed bsz to bs for consistency; removed dead code
#299
Conversation
[ghstack-poisoned]
facebook-github-bot
added
the
CLA Signed
| Attributes: | ||
| n_kv_heads (int): Number of key and value heads. | ||
| n_heads (int): Number of query heads. | ||
| n_local_kv_heads (int): Number of local key and value heads. |
There was a problem hiding this comment.
not an attribute (only one occurrence of n_local_kv_heads if you search in this file)
| torch.Tensor: Output tensor after attention. | ||
| """ | ||
| bsz, seqlen, _ = x.shape |
There was a problem hiding this comment.
all inline comments in this method use bs for batch size so can make this bs for consistency
| torch.Tensor: Output logits after applying the Transformer model. | ||
| """ | ||
| _bsz, seqlen = tokens.shape |
There was a problem hiding this comment.
similarly, _bsz is unused, so just remove
There was a problem hiding this comment.
if it helps readability to know the tokens.shape is (batch size, sequence length), I can keep it and maybe rename it to _bs?
There was a problem hiding this comment.
Although not used, it improves code readability -- it tells how many dimensions tokens has, and what they are. So IMO I'd wish they are kept. Also, the "unusedness" has been indicated using the _ prefix.
There was a problem hiding this comment.
if it helps readability to know the
tokens.shapeis (batch size, sequence length), I can keep it and maybe rename it to_bs?
just saw this message, yeah I agree
| torch.Tensor: Output logits after applying the Transformer model. | ||
| """ | ||
| _bsz, seqlen = tokens.shape |
There was a problem hiding this comment.
Although not used, it improves code readability -- it tells how many dimensions tokens has, and what they are. So IMO I'd wish they are kept. Also, the "unusedness" has been indicated using the _ prefix.
some minor cleanups [ghstack-poisoned]
ghstack-source-id: bbedad3 Pull Request resolved: pytorch#299
ghstack-source-id: bbedad3 Pull Request resolved: pytorch#299
Stack from ghstack (oldest at bottom):
bsztobsfor consistency; removed dead code #299some minor cleanups