I’ve just discovered OmniGPT that seems to be a chat where you can interact with different LLM (Claude, GPT-4, Llama, Gemini, etc.) and costs $16/month (it was $7/month until a week ago 🤦‍♂️). I’ve read on a Reddit post that it uses the APIs of all the provider that is a thing that can be done for free using a personal account (since the API limit seems to be high). Do you know something like OminGPT that can be self hosted that uses users API keys?

  • peanuts4life@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    6
    ·
    7 months ago

    I believe Librechat would achieve your goals, but you’d need a PC or server to host it in. It supports all major API.

    Kobold light might with as well, and doesn’t need to be hosted locally, but I don’t think it supports Claude haiku specifically, for unknown reasons.

    Additionally, the official Claude api workshop is pretty good on desktop, but it only supports Claude.