ARTICLE AD BOX
Typically in order to pass non-textual data (audio, image, video) to a model you would need to save the data to a file and then specify the path (or url) to the file.
messages = [ { "role": "user", "content": [ { "type": "audio", "url": "https://huggingface.co/datasets/raushan-testing-hf/audio-test/resolve/main/glass-breaking-151256.mp3", }, {"type": "text", "text": "What do you hear in this audio?"}, ], }, ]This in quite inefficient. Is there any other way without using an intermediate file?
