good open source translation that runs locally on a Mac?

August 4, 2024 2:54 PM

I've been using the excellent Whisper to transcribe and translate audio. I'd like something faster and maybe better for the translation step that can translate text to text (without the audio). Is there open source translation software that will run locally (without accessing the internet) on my Mac to translate the text (without the audio) between languages (English, Spanish, German, French, Italian, Japanese)? Thanks!
posted by kristi to Computers & Internet (4 answers total)

There's Meta's SeamlessM4T that can do the speech-to-text step and translation step simultaneously. I don't know how easy it is to get running, though.
posted by credulous at 3:23 PM on August 4, 2024

Response by poster: Thanks, credulous!

I fear I've phrased my question badly by including Whisper. To rephrase:

Is there open source translation software that will run locally (without accessing the internet) on my Mac to translate text between languages (English, Spanish, German, French, Italian, Japanese)?
posted by kristi at 3:47 PM on August 4, 2024

You could install ollama (or install with Homebrew) and use one of the LLMs. Example:

% ollama run glm4
>>> Output only translated text. Translate this sentence to Japanese: "this is a good sentence for translating"
これは翻訳に適した良い文です。

There are probably many better ways to structure the prompt, and/or use the Ollama API, but that's the idea.
posted by credulous at 4:07 PM on August 4, 2024 [1 favorite]

Actually this is a better way to use it:

% ollama run glm4
>>> /set system "You translate phrases into Spanish. Output the translation with no additional text or delimiters."
Set system message.
>>> howdy partner
hola amigo

posted by credulous at 5:27 PM on August 4, 2024 [2 favorites]