All projects
tool

Twitch Moderator API

Server in charge of Text to speech, ChatGPT and Alert in my streams twitch chat!

Role
Solo Dev
Date
Mar 18, 2023
Status
Finished
Type
tool
Built with
NestJS, Typescript, VScode Extension
Twitch Moderator API tools and integrations displayed over a dark background.

Technologies Used

Purpose

I was doign live stream at the time, so i wanted to see how to do custom integrations for text to speech and using AI to answer questions in the chat about my code

Streaming was a good excuse to connect a lot of things that normally live separately. Every small idea from the chat could become another command, alert or experiment for the next stream.

What it did

In the beginning, I developed this API primarily to incorporate custom alerts into my weekly streams, specifically for subscriptions and follows. As I progressed, I expanded its functionality to support Spotify music queues, allowing chat followers to contribute songs to the current playlist. Additionally, I incorporated text-to-speech support, enabling any messages typed in the chat to be both spoken and displayed on the screen through a special command.

Ultimately, recognizing that most of my viewers were not proficient in programming languages like C# and TypeScript, I decided to create a Visual Studio Code extension. This extension allows individuals in the chat to inquire about specific lines of code, and with the assistance of OpenAI API, I can provide explanations for those lines of code. Furthermore, chat users can post questions on any topic to Chat GPT and get the responses as a reply in twitch chat.

Source Code

Closed code.

General diagram

Screenshots

Text to speech demo

Additional Information

I’ve used this tool in every single stream, and it has proven to be incredibly valuable, particularly when it comes to addressing spontaneous questions that arise during the stream.