Skip to content

Conversation

@gabrieldemarmiesse
Copy link
Member

Copy link
Member

@seanpmorgan seanpmorgan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks! #1220 created to track the gelu issue

@seanpmorgan seanpmorgan merged commit 697e53a into tensorflow:master Mar 5, 2020
@gabrieldemarmiesse gabrieldemarmiesse deleted the more-precision branch March 8, 2020 16:32
jrruijli pushed a commit to jrruijli/addons that referenced this pull request Dec 23, 2020
* Better precision when comparing implementations.
* Gelu with float32 has not the same gradient as the C++ version.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants