新增fused transformer encoder 中文文档 #4022
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
TCChenlong
reviewed
Oct 28, 2021
| ------------------------------- | ||
| .. py:class:: paddle.incubate.nn.FusedFeedForward(d_model, dim_feedforward, dropout_rate=0.1, activation='relu', act_dropout_rate=None, normalize_before=False, weight_attr=None, bias_attr=None) | ||
|
|
||
| 这是一个调用融合算子fused_feedforward（参考:ref:`cn_api_incubate_nn_functional_fused_feedforward` ）。 |
Collaborator
There was a problem hiding this comment.
这里链接格式有问题。应该在参考后面加一个空格
| - **dim_feedforward** (int) - 前馈神经网络中隐藏层的大小。 | ||
| - **dropout_rate** (float，可选) - 对本层的输出进行处理的dropout值, 置零的概率。默认值：0.1。 | ||
| - **activation** (str，可选) - 激活函数。默认值：``relu``。 | ||
| - **act_dropout_rate** (float，可选) - 激活函数后的dropout置零的概率。如果为 `None` 则 `act_dropout_rate = dropout_rate` 。默认值： `None` 。 |
Collaborator
There was a problem hiding this comment.
这里的格式应该都是两个 ` 而不是一个 `；一个的格式是斜体；下面的部分也同理
zkh2016
pushed a commit
to zkh2016/docs
that referenced
this pull request
Oct 28, 2021
* 修改错别字 * 备注CPU不支持float16 * update example * add fused_feedforward * add fused_feedforward * add fused_feedforward * opt the description * update docs * update docs * update doc * move fused_feedforward docs position * add incubate/nn/layer * move fused transfomrer doc to incubate/nn/ * modify the doc * modify fused transformer encoder layer doc
TCChenlong
pushed a commit
that referenced
this pull request
Oct 28, 2021
* 新增一个融合算子:fused_feedforward (#3999) * 修改错别字 * 备注CPU不支持float16 * update example * add fused_feedforward * add fused_feedforward * add fused_feedforward * opt the description * update docs * update docs * update doc * move fused_feedforward docs position * 新增fused transformer encoder 中文文档 (#4022) * 修改错别字 * 备注CPU不支持float16 * update example * add fused_feedforward * add fused_feedforward * add fused_feedforward * opt the description * update docs * update docs * update doc * move fused_feedforward docs position * add incubate/nn/layer * move fused transfomrer doc to incubate/nn/ * modify the doc * modify fused transformer encoder layer doc
TCChenlong
pushed a commit
that referenced
this pull request
Dec 9, 2021
* 新增一个融合算子:fused_feedforward (#3999) * 修改错别字 * 备注CPU不支持float16 * update example * add fused_feedforward * add fused_feedforward * add fused_feedforward * opt the description * update docs * update docs * update doc * move fused_feedforward docs position * 新增fused transformer encoder 中文文档 (#4022) * 修改错别字 * 备注CPU不支持float16 * update example * add fused_feedforward * add fused_feedforward * add fused_feedforward * opt the description * update docs * update docs * update doc * move fused_feedforward docs position * add incubate/nn/layer * move fused transfomrer doc to incubate/nn/ * modify the doc * modify fused transformer encoder layer doc * add some args (#4096) * fix typo (#4105) * fix typo * fix typo * fix ffn doc * fix ffn doc * fix typo
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.