Use LLMs to produce reactions that go to the 3D model based on intent from chat conversation Frontend with React, Typescript, React-Three-Fiber, Backend with fastapi, OpenAI api, instructor
I wanted to do an application with 3D characters, chat with LLMs and animations, so I did this poc.
(Despite the animation controls in the screen they were being triggered by the LLM from the backend)