The pathological need to find something to use LLMs for is so bizzare.
It’s like the opposite of classic ML, relatively tiny special purpose models trained for something critical, out of desperation, because it just can’t be done well conventionally.
But this:
AI-enhanced tab groups. Powered by a local AI model, these groups identify related tabs and suggest names for them. There is even a “Suggest more tabs for group” button that users can click to get recommendations.
Take out the word AI.
Enhanced tab groups. Powered by a local algorithm, these groups identify related tabs and suggest names for them. There is even a “Suggest more tabs for group” button that users can click to get recommendations.
If this feature took, say, a gigabyte of RAM and a bunch of CPU, it would be laughed out. But somehow it ships because it has the word AI in it? That makes no sense.
I am a massive local LLM advocate. I like “generative” ML, within reason and ethics. But this is just stupid.
I agree with you on almost everything.
It’s like the opposite of classic ML, relatively tiny special purpose models trained for something critical, out of desperation, because it just can’t be done well conventionally.
Here i disagree. ML is using high dimensional statistics. There exist many problems, which are by their nature problems of high dimensional statistics.
If you have for an example an engineering problem, it can make sense to use an ML approach, to find patterns in the relationship between input conditions and output results. Based on this patterns you have an idea, where you need to focus in the physical theory for understanding and optimizing it.
Another example for “generative AI” i have seen is creating models of hearts. So by feeding it the MRI scans of hundreds of real hearts, millions of models for probable heart shapes can be created and the interaction with medical equipment can be studied on them. This isn’t a “desperate” approach. It is a smart approach.
Based on this patterns you have an idea, where you need to focus in the physical theory for understanding and optimizing it.
How do you tell what the patterns are, or how to interpret them?
The recognition of the pattern is done by the machine learning. That is the core concept of machine learning.
For the interpretation you need to use your domain knowledge. Machine learning together with knowledge in the domain analyzed can be a very powerful combination.
Another example in research i have heard about recently, is detection of brain tumors before they occur. MRIs are analyzed of people who later developed brain tumors to see if patterns can be detected in the people who developed the tumors that are absent in the people who didn’t develop tumors. This knowledge of a correlation between certain patterns and later tumor development could help specialists to further their understanding of how tumors develop as they can analyze these specific patterns.
What we see with ChatGPT and other LLMs is kind of doing the opposite by detaching the algorithm from any specific knowledge. Subsequently the algorithm can make predictions on anything and they are worth nothing.
TBH despite I don’t like this specific idea, nor use Firefox directly, I do like the usage of local inference vs sending your data to thirdparty to do AI.
They just needed to do it OPT IN, not OPT OUT.
It is though.
then why the fuck is this newsworthy? ugh. Why is there such a huge hateboner for firefox lately?
I really don’t get it either.
It’s not like it’s a paid product either.
Because they keep betraying their supposed values for short-term gains.
What is the gain? What is a single gain you think they have milked from their users?
Money for their executives
Firefox does run better when you disable all “ml.chat” settings.
where is this AI bloat exactly? I use Firefox every day and see no difference
There is none, this is all AI=bad knee-jerk reaction. From what I can tell, so far Firefox has 3 ML-based systems implemented:
- Site / text translation - fully local, small model, requires manual action from user
- Tab grouping suggestions - fully local, small model, requires manual action from user
- Image alt text generation (when adding images to a PDF) - fully local, small model, looks like it’s enabled by default but can be turned off directly in the modal that appears when adding alt text
All of these models are small enough to be quickly run locally on mobile devices with minimal wait time. The CPU spikes appear to be a bug in the inference module implementation - not an intended behavior.
Firefox also provides UI for connecting to cloud-based chatbots on a sidebar, but they need to be manually enabled to be used. The sidebar is also customizable so anyone who doesn’t want this button there can just remove it. There’s also a setting in about:config that removes it harder.
I actually really like the way Mozilla is introducing these features. I recently had to visit another country’s post office site and having the ability to just instantly translate it directly on my device is great.
You meant to tell me the general public has kneejerk reactions and don’t know how a computer works?
What a shock that lemmy bashes Mozilla for doing their job.
I just wish one could donate to firefox development specifically. Then they could rid it of all the advertisement and tracking stuff.
Bless your heart.
They will do whatever they believe will maximize profit.
I thought mozilla was a non profit?
Non-profit isn’t the same as not-for-profit
Take American Red Cross
They make bank on blood donations. Also, they take in way more than they put out.
The red cross fucking sucks too
I couldn’t agree more
This smells like BS.
Is mozilla non-profit, not-for-profit, or for-profit?
You dont really know do you.
“I dont like mozilla so ill just assume they must be profiteering assholes somehow”
“Its the vibe of the thing”
I only use Firefox. I’ve only used Firefox since 2000.
They, by their own statements, are a 501( C )3, which is a non-profit, not a not-for-profit.
Sit down.
You seem to be able to google “mozilla non profit” but unable to elucidate whether it is in fact a non-profit and why that is so.
Again, you’re offering hand wavy vibe based explanations as to why mozilla is “bad”. What exactly is the problem?
I have worked for non-profits.
They are completely allowed to make a profit.
You are mistakenly under the impression that I’m against Mozilla.
If you go back to my original comment, I merely explained what I explained here. Mozilla is a non-profit, not a not-for-profit.
You decided to take that as an attack on Mozilla, for some strange reason, and attacked me. I just turned that same energy back on you.
Did I ever attack Mozilla? Did you attack me?
Do you have to enable the feature first? Because I’m on v141 and I don’t see this feature. Complaining about a useless and draining feature that you yourself enabled is a special kind of stupid tbh.
deleted by creator
Because people seem to have a special hate boner for Firefox on here.
And please don’t call me bro.
Edit: hate not hat
There’s a lot of negativity from certain users/communities on software/services that are mostly good but have imperfections. I rarely if ever see any recommendations for alternatives that actually make sense when this happens.
Firefox and Proton are two very common targets. Sure, they are both not perfect, but they are both offering a solution that does not enrich the current oppressive market leader and they do a pretty solid job at it.
Yes, flaws deserve to be criticized, but there’s such a thing as too much.
It’s tiring.
