Auto Caption is a cross-platform real-time caption display software.

Version v0.2.0 has been released. Version v1.0.0, which is expected to add a local caption engine, is under development...

Star History

📥 Download

GitHub Releases

📚 Related Documentation

Auto Caption User Manual

Caption Engine Explanation Document

Project API Documentation (Chinese)

Basic Usage

Currently, only an installable version for the Windows platform is provided. If you want to use the default Gummy caption engine, you first need to obtain an API KEY from the Alibaba Cloud Model Studio and configure it in the environment variables. This is necessary to use the model properly.

The international version of Alibaba Cloud does not provide the Gummy model, so non-Chinese users currently cannot use the default caption engine. I am trying to develop a new local caption engine to ensure that all users have access to a default caption engine.

Relevant tutorials:

• Obtain API KEY (Chinese)
• Configure API Key in Environment Variables (Chinese).

If you want to understand how the caption engine works or if you want to develop your own caption engine, please refer to the Caption Engine Explanation Document.

✨ Features

• Multi-language interface support
• Rich caption style settings
• Flexible caption engine selection
• Multi-language recognition and translation
• Caption record display and export
• Generate captions for audio output and microphone input

Notes:

• The Windows platform supports generating captions for both audio output and microphone input.
• The Linux platform currently only supports generating captions for microphone input.
• The macOS platform is not yet supported.

🚀 Project Execution

Install Dependencies

npm install

Build Caption Engine

First, navigate to the caption-engine folder and execute the following command to create a virtual environment:

python -m venv subenv

Then activate the virtual environment:

# Windows
subenv/Scripts/activate
# Linux
source subenv/bin/activate

Next, install the dependencies (note that if you are in a Linux environment, you should comment out PyAudioWPatch in requirements.txt, as this module is only applicable to the Windows environment):

pip install -r requirements.txt

Then build the project using pyinstaller:

pyinstaller --onefile main-gummy.py

At this point, the project is built. You can find the executable file in the caption-engine/dist folder and proceed with further operations.

Run the Project

npm run dev

Build the Project

Note that the software is currently not adapted for the macOS platform. Please use Windows or Linux systems for building, with Windows being more recommended due to its full functionality.

# For Windows
npm run build:win
# For macOS, not avaliable yet
npm run build:mac
# For Linux
npm run build:linux