<aside> <img src="/icons/book_blue.svg" alt="/icons/book_blue.svg" width="40px" /> Daily AI repo https://git.new/ai

</aside>

<aside> <img src="/icons/book_blue.svg" alt="/icons/book_blue.svg" width="40px" /> Example apps Repo

</aside>

What is Daily AI?

Daily AI  is an open-source Python toolkit for building real-time generative AI bots, powered by voice and video.

Things like personal coaches, meeting assistants, story-telling toys for kids, customer support bots, and snarky social companions.

Daily AI makes adding multi-modal capabilities a breeze, and much faster.

When building real-time AI apps, it can be a challenge to manage the sequencing of all the various inputs and outputs to achieve a smooth, human-like conversation.

Daily AI abstracts the complexity of voice and video workflows — chain different AI services together, easily implement real-time transport, and use battle-hardened helpers for things such as voice-activity detection, interruptibility, phrase end-pointing and more!

Who are Daily?

Daily AI was built by daily.co who specialize in developer tools, APIs and infrastructure for real-time video and audio. The framework is fully open-source, and works great out of the box with Daily’s infrastructure for creating a real-time (WebRTC) connections between user and bot.

Some key concepts when building real-time AI experiences:

• Latency — for conversations to feel natural and fluid, the time it takes for voice or video data to travel across the internet is really, really important. “Real-time” often refers to anything less than 200ms. There is a lot of complexity involved in chaining speech-to-text, LLM prompting, text-to-speech at real-time speeds, which is what Daily AI was designed to help solve.
• Transport — to ‘transport’ video and audio data across the internet really fast, you need to work with the right technologies. Web Sockets are great, but can result in issues at scale, especially under poor network conditions (read more about that here.) WebRTC was designed with this purpose in mind; Daily AI includes a WebRTC transport (powered by Daily) within the repo.
• Service adapters — Daily AI includes plug-and-play adapters for common AI services, such as OpenAI, Eleven Labs, Fal etc. If you have a favorite AI service that doesn’t have a service, writing your own is really easy, and we encourage you to do so!