• GenderNeutralBro@lemmy.sdf.orgEnglish
    1033·
    2 months ago

    Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

    Hmm.

    >locally hosted

    >Google Cloud

    Hmmmmmmmmmmmmmmmm.

    • SzethFriendOfNimi@lemmy.world
      441·
      2 months ago

      Sounds like they’re running their own LLM instance on googles cloud infrastructure vs using something like OpenAI via API.

      As web dev parlance it makes sense but for marketing it is definitely confusing and they should do better.

      • sugar_in_your_tea@sh.itjust.works
        2·
        2 months ago

        Yeah, we “self-host” our app at AWS at work, which means we configure everything ourselves. I “self-host” a VPS at Hetzner for personal projects, and my actual data is actually self-hosted on a machine on my LAN.

    • Bitrot@lemmy.sdf.orgEnglish
      22·
      2 months ago

      It’s a thing.

      Remember how the cloud is someone else’s server? Now you can buy it (or lease) and bring it home, and it becomes only sorta someone else’s.

      Amazon and Azure offer their own on-prem products.

      • GenderNeutralBro@lemmy.sdf.orgEnglish
        91·
        2 months ago

        “Locally hosted” means it’s running on the local host. In this case, that would mean on the same computer running Firefox.

        Calling something that is only accessible over the internet “locally hosted” is outrageous doublespeak.

            • Bitrot@lemmy.sdf.orgEnglish
              8·
              2 months ago

              If they had said “locally hosted in our datacenter” would you be confused why they didn’t move a rack into your house?

              My question is why are you projecting your limited interpretation as a global truth?

              • Mr. Satan@monyet.cc
                61·
                2 months ago

                In IT context local is a well establised term. It’s either hosted locally, i. e. on machine running the browser or not. A datacenter or cloud are remote machines also by the same well established definition.

              • LWD@lemm.ee
                4·
                2 months ago

                The language is confusing, and Mozilla should fix it themselves.

                The important takeaway is: data is sent over an IP address controlled by Google, to a remote server, running Google software. No processing is taking place on someone’s local computer.

              • GenderNeutralBro@lemmy.sdf.orgEnglish
                3·
                2 months ago

                If they had said “locally hosted in our datacenter”

                Then that would also be an oxymoron.

                Local is the opposite of remote. This is a remote server. Remote servers are not local. This is not a matter of interpretation.

                • Bitrot@lemmy.sdf.orgEnglish
                  31·
                  2 months ago

                  It is, actually. It is local to them, it is remote to you. They are differentiating from a remote server in someone else’s datacenter. It is not that confusing.

      • smpl@discuss.tchncs.deEnglish
        1·
        2 months ago

        lol, I think we’re giving too little credit to the marketing people in tech. I want to read their blogs!

      • LWD@lemm.ee
        1·
        2 months ago

        Information We Share.

        We use third parties to provide the Service to you, and have contracted with these companies requiring them to protect your information (Third-Party Services):

        Google Cloud Platform. Google Cloud Platform (GCP) is a cloud-computing platform. We use GCP to manage services that facilitate responses to user prompts and page summarization.

        https://orbitbymozilla.com/privacy

  • redditReallySucks@lemmy.dbzer0.com
    43·
    2 months ago

    https://orbitbymozilla.com/terms

    4. Content

    A. Content You Share

    By using the Services, you represent that you will only share material (including Inputs) that you own and/or have the legal right to share and sublicense to others, including without limitation, content and data contained in any web-page shared through the Services to generate Outputs. When you submit your own content through the Services, you continue to own the rights to that content. You grant Mozilla a worldwide, royalty-free, perpetual, irrevocable, non-exclusive, transferable license to use, copy, modify, adapt, sub-license, prepare derivative works from, distribute, perform, and display the Inputs for the purpose of operating the Services.

    • LWD@lemm.ee
      26·
      2 months ago

      Thanks for the link to the privacy policy. You notice, at the bottom, it has links to both “About Mozilla” and “About FakeSpot”?

      When you run the Orbit extension, it connects to two domains with every request:

      1. orbitbymozilla.com
      2. prod.orbit-ml-front-api.fakespot.prod.webservices.mozgcp.net

      There’s FakeSpot again.

      And FakeSpot has a terrible privacy policy that allows sale of private data directly to advertisers.

      • sugar_in_your_tea@sh.itjust.works
        8·
        2 months ago

        Yeah, that’s a no-go. I probably wasn’t going to use it anyway, but if it had a decent privacy policy, I might at least try it.

        But no, not happening.

  • themeatbridge@lemmy.world
    454·
    2 months ago

    I don’t want that. I want full control and absolute privacy. I do not want your AI reading my emails. Look at that summary, it’s as long as the whole email, and you’re not going to be able to trust that it picked up on the most important part of the email. This is not efficiency, this is novelty.

      • LWD@lemm.ee
        2·
        2 months ago

        So do you actually draw the line at Mozilla never building stuff like this into their browser, or is that a line you would be willing to cross too?

      • LWD@lemm.ee
        2·
        2 months ago

        I won’t trust the AI Mozilla uses until they show us the source data. Not the source code that consumes a massive binary blob; the stuff that generated the binary blob they are using.

        • sugar_in_your_tea@sh.itjust.works
          3·
          2 months ago

          Not far enough. I won’t trust it until I can build it myself and self-host it. Then if they provide reproducible builds and hashes of the currently running build, I can decide whether it’s better to use their hosted version or my own.

          • LWD@lemm.ee
            1·
            2 months ago

            I’d want both.

            My biggest gripe is that when companies provide “source code,” it often is technically reproducible and “works,” but only with a gigabytes-large binary blob that cannot be debugged and will not be sourced.

      • themeatbridge@lemmy.world
        31·
        2 months ago

        I won’t. But my concern is that Mozilla is heading in the wrong direction lately, and I have used Firefox for a very long time.

          • sugar_in_your_tea@sh.itjust.works
            1·
            2 months ago

            Yes, I’m glad this BS is an extension. I’m not happy that they’re spending time on this vs projects people actually seem to want. AI appeared nowhere on the top-10 survey results, yet this is what they come up with. I just hope they didn’t spend a ton of time on it.

      • Draconic NEO@lemmy.world
        1·
        2 months ago

        Thing is, Pocket is also an extension. Just much less optional. If Mozilla makes this AI thing part of their flagship in a lot of the same ways. Possibly even more. It’s not about what it is now, but rather what it means for the future of Mozilla and Firefox.

      • sugar_in_your_tea@sh.itjust.works
        1·
        2 months ago

        Here’s the summary of their example article (or perhaps the page?):

        This email expresses a sarcastic and exaggerated perspective on the advancements and implications of Artificial Intelligence (AI). The author begins by expressing excitement about the technological marvels of AI, but then proceeds to poke fun at the complexity and convoluted nature of AI, its ability to predict our actions, and the replacement of human interaction with AI chatbots. The author also mocks the idea of AI-generated content and its ability to replicate human creativity, and the potential ethical concerns of relying on AI for decision-making. The email concludes with a sarcastic call to embrace the “glory” of AI and its potential to take over human autonomy. The tone of the email is light-hearted and humorous, but it also raises valid concerns about the role and impact of AI on our lives.

        This isn’t really a summary, there’s some interpretation going on as well. I don’t want AI to do any form of interpretation, but if it does so, it should be as metadata below the actual summary.

        And honestly, I almost never get an email that I actually want to summarize. Most of them I can either completely ignore (corporate BS), or they’re short and to the point. So it’s weird to me that email is the first thing they mention.

        • christophski@feddit.ukEnglish
          2·
          1 month ago

          I did exactly this at work the other day. Someone had forwarded a full email thread to me and asked my opinion on it - they gave no summary or outline of the thread and expected me to read through it. I don’t have time to read through a full thread and work out what they want from me so I copied it into chatgpt and asked it to summarise and tell me points that might need my attention. It was pretty good

  • thingsiplay@beehaw.org
    17·
    2 months ago

    Orbit currently uses a version of Mistral LLM (Mistral 7B) that is locally hosted on Mozilla’s Google Cloud Platform instance.

    So it connects to Google Cloud for this? What does that mean “locally”, if its a Cloud Platform? And what does that mean “Mozilla’s”, if its Google? I’m a bit confused with this sentence.

    Does it download and execute it locally offline or does it send the data to Google Cloud Platform?? The page is not clear about this and I searched for an answer. I have the same Mistral 7B model that I downloaded from HuggingFace website and can use offline with a specific GUI application. It would be nice if I could Firefox point to that file instead.

    Otherwise, this does not look very promising and I wouldn’t trust it at the moment.

    • Bitrot@lemmy.sdf.orgEnglish
      18·
      2 months ago

      Google Distributed Cloud allows you to run Google Cloud Platform locally in your own datacenter. They can deploy apps to that infrastructure and use the cloud console for management, or even use normal kubernetes tools for it.

      Couldn’t say if that’s what they’re actually doing, but running Google Cloud locally is a thing.

      • thingsiplay@beehaw.org
        2·
        2 months ago

        Thanks for the clarification. That’s interesting indeed. Unfortunately Mozilla is so dependent on Google.

        • Bitrot@lemmy.sdf.orgEnglish
          4·
          2 months ago

          I agree. I’d prefer they just run their own Kubernetes and manage it themselves. Maybe throw some business at Red Hat if they need help with it.

  • thawed_caveman@lemmy.world
    14·
    2 months ago

    “Yeah sorry boss, i didn’t actually read the email, instead i had an AI summarize it for me and it got a key detail wrong. Anyway what’s a couple thousand dollars in lost sales right”

  • sub_ubi@lemmy.ml
    111·
    2 months ago

    why are they promoting web-based mail when their email solution is thunderbird?

  • sabreW4K3@lazysoci.al
    51·
    2 months ago

    Not available on mobile, which is sad. I consume 99% of my internet via mobile devices.

    • Draconic NEO@lemmy.world
      2·
      2 months ago

      It is but it’s also natural for them, they’re slowly transitioning to a closed source company like all the other big tech companies. The hope is that we don’t notice, or that those of us who do notice are a small minority who can be stomped out or discredited by those who don’t notice or are in their pocket.

      Reddit too used to be open source, they’re not anymore. This shit does happen, regardless of what anyone says.

      • LWD@lemm.ee
        2·
        2 months ago

        Never meet your heroes, or better yet, never have heroes.