OpenAI - Add audio functionality to Chat action

[pipedream-component-development]

App

OpenAI
https://openai.com/index/introducing-the-realtime-api/

Actions

This is a request to update chat completion workflow to accept audio input, as that is now supported

[Stvad]

Audio in the Chat Completions API will be released in the coming weeks, as a new model gpt-4o-audio-preview. With gpt-4o-audio-preview, developers can input text or audio into GPT-4o and receive responses in text, audio, or both.

Looking at model options rn, I can select gpt-4o-audio-preview model, but not supply the audio as an input

[malexanderlim]

@Stvad , it looks like the API documentation in chat completions has not been updated to include audio yet - as soon as it is ready and documented, we will update the chat completions action. Thanks!
https://platform.openai.com/docs/api-reference/chat/create

[Stvad]

It seems like they updated it, the link you posted now mentions audio and links out to https://platform.openai.com/docs/guides/audio?audio-generation-quickstart-example=audio-in

[malexanderlim]

Awesome - we'll be sure to get the Chat action updated with the audio functionality! Thank you for flagging @Stvad.