Hacker Newsnew | past | comments | ask | show | jobs | submit | more Tepix's commentslogin

Hey, wait a minute. I think we got something here! What we need is the reverse, i.e. a LLM that recognizes clickbait and "tames" it (ideally by providing the information in the headline, like Techmeme does [kudos to them]).


https://www.bullshitremover.com/

I have a lot of fun with this.


it is not very good at removing nonsense from OP's page :(.


I had another idea about the same topic a few weeks ago: Creating a news side which uses the clickbait strategy to only share positive news or mentaly opening up news:

“They Said Immigration Was a Crisis — Then THIS Happened to Jobs, Growth, and Local Communities”

“Everyone Expected Chaos… Instead This City Welcomed Newcomers and Its Economy EXPLODED”

“Doctors, Teachers, Builders: The ‘Immigration Problem’ Quietly Fixed a Problem No One Talks About”

“This ‘Risky’ Policy Was Supposed to Fail — Now Other Countries Are Rushing to Copy It”

“From ‘Unmanageable’ to Unstoppable: How One Tough Challenge Became a Surprising Success Story”


This is exactly what Upworthy did - they invented some of the clickbait headline formats that are still used today (for less positive news) https://web.archive.org/web/20231114181702/https://www.fastc...


12 reasons why Go will make you a better developer!


Like goodnews.eu?


This is a great idea: applying LLMs for the benefit of those I care about against the armies of tech company PhD's working to capture their attention.

Actually worth a shot, thanks!


There is a browser extension that does it for YouTube (but crowdsourced)


Linux already has RDMA support but it cannot yet use Thunderbolt. It's probably quite a bit of work to add everything that's required. Is anyone working on it?

It would be great to have this for those cheap Strix Halo boxes with 128GB quad channel DDR5-8000 for using two or three of them with their 2 USB4 ports (which are Thunderbolt capable) to fit larger models.


I assume that's Thunderbolt 5? From my experience, eGPUs over USB 4/TB3 work just fine (from a technical point of view, in practice 40Gbps isn't enough BW and performance is shit)


Yes, that works but what's needed here is remotely accessing RAM on another PC via RDMA via Thunderbolt. Not accessing a standalone eGPU.


> Linux already has RDMA support but it cannot yet use Thunderbolt.

Is TB still encumbered by licensing requirements causing this lack of use?


I don't understand why it's so difficult (impossible?) with Firefox to use your own private AI server (that's not running on localhost). With Brave it's pretty easy.


This is why they stopped The Flash after season 9 in 2023.


If it uses 18GB of RAM, you're not using the official model (released in BF16 and FP8), but a quantization of unknown quality.

If you write "M4", you mean M4 and not M4 Pro or M4 Max?


Is it just me or is Nvidia trolling hard by calling a model with 30b parameters "nano"? With a bit of context, it doesn't even fit on a RTX 5090.

Other LLMs with the "nano" moniker are around 1b parameters or less.


FWIW It runs on my 9060xt(AMD) 16gb, without any tweaks just fine. It's very useable. I asked it to write a prime sieve in c#, started responding in .38 seconds, and wrote an implementation @ 20 tokens/sec


But you're using a 3rd party quant of unknown quality. Nvidia is only providing weights as BF16 and FP8.


Getting ~150 tok/s on an empty context with a 24 GB 7900XTX via llama.cpp's Vukan backend.


Again, you're using some 3rd party quantisations, not the weights supplied by Nvidia (which don't fit in 24GB).


I wonder what performance remains on 12GB VRAM GPU when local ollama ties in the systems RAM to run this huge nano model.

https://github.com/jameschrisa/Ollama_Tuning_Guide/blob/main...


As a US corporation, Mozilla cannot compete on privacy focused services. If they want to focus on privacy (which I think is great), they should ship software that improves privacy, not offer services.


Are you saying that a warrant canary isn't useful?


He is saying that no one outside of the US will trust them with their data, because of the US Cloud Act and similar legislation.

There is a reason Proton & Co are based in Switzerland and not in the US


They can compete where the alternatives are also US based services.

They can compete in the US.

There are also many people who are more concerned about privacy from businesses than from governments. There are also people who are more concerned about privacy from their own government than a foreign government.

Although the Cloud Act and similar issues with the US are much discussed here, I see no sign it loses American big tech much business.


> There are also many people who are more concerned about privacy from businesses than from governments.

We're living in an interesting time that may (or may well not!) turn out to be a pivot point in this question. People being ICE'd based on data traces they leave in commercial products may well make this kind of question more tangible to non-technical folks.

> Although the Cloud Act and similar issues with the US are much discussed here, I see no sign it loses American big tech much business.

If that is true (which it may or may not be) then it would also mean competing on privacy isn't a winning move, whether within or outside the US.


lots of people seem to trust apple


Marketing can do a lot to create trust.

It's not all or nothing. Depending on your threat model, Apple's services might be fine. But I guess most people don't think enough about the implications of storing many years worth of data at a US company like Apple.


Apple has actually proven itself over a long period of time on this issue. Maybe Mozilla has as well (do they encrypt telemetry logs etc for people with a Mozilla login?) but I haven't heard so much about that.



Wrong. Apple explicitly preserves a backdoor in the e2ee of iMessage for the USG.


Source?



Did you really forgot about Snowden's Apple slide? Also their phones are routinely mirrored at the border. Just to support the unconstitutional government agenda of policing thoughts and speech.


> Did you really forgot about Snowden's Apple slide?

Was Apple coöperating or were they hacked? (I remember the smiley face for Gmail. Google, in that case, was hacked.)


Yes but Apple is also avoiding collecting a huge amount of data, e.g. by doing things on-device.



Ok, keep telling yourself that as you can’t remove iCloud…


In particular it is very regrettable if we look at how Apple has treated the mobile safari browser.


That's still a lot cheaper than getting a bunch of B300s.


I think he's referring to Boom and also to xAI.


There's many more. Aeroderivative gas turbines are not exactly new, and they have shorter lead times than regular gas turbines right now, so everybody getting their hands on any has been willing to buy them.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: