…or at least the kind of model that isn’t fueled by burning a small forest for every query? I am wanting to play an old video game, but I’m still only just learning the language and could use an aid. I really, really want to avoid any of this incredibly wasteful AI stuff.

  • Awoo [she/her]@hexbear.net
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 hours ago

    If you’re talking about one of those plugins/mods then the AI translation is occurring locally on your machine. The increase in processing use is you on your machine, not a warehouse.

  • PorkrollPosadist [he/him, they/them]@hexbear.net
    link
    fedilink
    English
    arrow-up
    13
    ·
    edit-2
    14 hours ago

    Try LibreTranslate. It is a “language model,” but it is not a “large” language model along the lines of something like ChatGPT. I am not sure what the training process entails, but it will run on a 10 year old dual core CPU without GPU acceleration. You can test it at libretranslate.org, or you can install it on your own machine if you have Python by running pip install libretranslate. I run LibreTranslate on a meager VPS (the CPU I just described) and the headroom left over from running Mastodon is enough to handle the translation queries locally, without making any remote requests.

  • lime!
    link
    fedilink
    English
    arrow-up
    1
    ·
    8 hours ago

    i knew this would happen. everything’s AI now, so everything must be bad. translation utilities have used machine learning methods for years, long before gpts got useful. translation doesn’t have nearly the power requirements of generative stuff. also, for the record, it’s not the usage of generative ai that’s wasteful, it’s building the model. the models are already built.

    but anyway, it sounds like you want to run something on your own machine. there are tools for this. some of them are engine-specific, others do video capture. RPG maker and various visual novel engines for example have tons of them, where you just run the game using the tool and it replaces all the text. there are similar things for emulators.

    is this something that’s desirable, or do you want to use the game more as a language learning guide so that the original text stays up? in that case the OCR path is probably better, using something like translumo or ugt. they will show the text in a separate window.

    • Awoo [she/her]@hexbear.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      8 hours ago

      where you just run the game using the tool and it replaces all the text. there are similar things for emulators.

      These are typically locally running LLMs that do the translating as you go along then cache it on the device. It’s why there’s a delay before the text is replaced, the delay is shorter on higher end machines that process it quicker.

      • lime!
        link
        fedilink
        English
        arrow-up
        2
        ·
        7 hours ago

        well, not typically llms. these tools have been around longer than the term.

        besides, i don’t see why it matters? energy-wise, the problem isn’t the tech, it’s the immense scale it’s deployed on in order to be instantly available to millions of people. running a translator locally is unlikely to show up on your electric bill if you play any games on your computer.