Hacker News new | past | comments | ask | show | jobs | submit | mapme's comments login

Living off 20k a year in a Hcol, where these salaries primarily occur, is next to impossible. Rent alone anywhere in SF area, for example San Jose, is 2k at a bare minimum for a 1BR, or 3k for a 2BR split between a roommate at 1.5k each. That means rent is 18k-24k, not to mention other living expenses (car, utilities, food, travel to visit family, etc.)


If you went to school at say UCLA you are already used to living with a roommate in your bedroom (sometimes four). That's $1000 in san jose. Say you have a partner, now it doesn't even seem so desperate. Now you are at $12k rent alone. Fly spirit and buy the airfare long out to visit mom and dad when tickets are like $200 (i get emails for $49 spirit fares sometimes). call it $13000 with five visits home a year. Food wise you can easily do $50 a week groceries buying basic ingredients like fresh produce and rice or tortillas and beans. Now we are at about $16000 with all your needs met and about $4000 left over for any oddball expenses. SF area has bussing too, and bike lanes if you didn't want to bother with car expenses.


Is there a OSS license that specifically precludes its use in LLMs or effectively does so?


The thing about fair use is that there’s nothing a license can do to prevent it. After all, that’s the whole point of fair use: to say that there’s valid reasons to use pieces of IP without regards to their licenses.

So, if the courts find in Microsoft and OpenAI’s favor (which remains to be seen despite the many armchair lawyers here), your license would mean jack squat.


They don't aim to. The problem is really just accreditation. If copilot copies a chunk of code for you, chances are the original author was perfectly happy for you to do that, and you put their name somewhere in your credits. Copilot copies the same code, but scrubs the original author. It may also be copying code that was not ok to copy but that's a seperate even worse issue.


Twitters data cannot fit on one machine. In 2015 their Hadoop cluster was 30 PB per earlier comments/their blog. How do you fit that on one machine?


They did not spend half their revenue on compute. It’s more like 20-25% for running data enters/staff for DCs. Check their earnings report.

Whats app is not an applicable comparison because messages and videos are stored on the client device. Better to look at Pinterest and snap, which spend a lot on infra as well.

The issue is storage, ads, and ML to name a few. For example, from 2015:

“ Our Hadoop filesystems host over 300PB of data on tens of thousands of servers. We scale HDFS by federating multiple namespaces.”

You can also see their hardware usage broken down by service as put in their blog.

https://blog.twitter.com/engineering/en_us/topics/infrastruc...

https://blog.twitter.com/engineering/en_us/a/2015/hadoop-fil....


Also Search (the article did says these wouldn’t fit to be fair but the discussion seems to be ignoring how much wouldn’t fit and why). Search is pretty expensive especially since to have it responsive you need the indexes to fit in memory—at least the Lucene variety, which at least in old YouTube videos Twitter used.


Twitter still uses Lucene. They built a custom codec for it, but doesn't change the cost too much.


Excluding a settlement from 2014 that was paid this year, Twitter would have made 500mil on 5B revenue in 2021. They were also GAAP profitable in 2019.

Additionally, the incentive from wall street is to spend all your money to grow users. Whether that is right or wrong it’s the path they chose which led to users and revenue roughly doubling over 5 years.

https://s22.q4cdn.com/826641620/files/doc_financials/2021/ar...

https://s22.q4cdn.com/826641620/files/doc_financials/2019/Fi...


Source?



One SRE, many SWE. Also have fun asking someone to be permanently oncall with one person on the team.

The cache clusters size are also described here for anyone who wants a good technical read over speculation. https://www.usenix.org/system/files/osdi20-yang.pdf


The OP claims he did the implementation (so he was the software engineer too?):

> I designed and implemented most of the tools that are keeping it running so I think I’m qualified to talk about it.


I read this as they built the “tools” (automation, orchestration, monitoring, etc.) for this system, not the system itself; which aligns with the common definition of SRE.


SRE is a mix of both. The expectation is you are able to write and understand any code the team is responsible for.


SWEs can share the oncall rotation with SRE.


Yes that is the normal case. The post was refuting the assertion that one engineer can run these services indefinitely as previously the OP had the help of SWEs oncall and also fixing bugs.


But Tesla and Spacex have notoriously low pay compared to their peers. Eg a Tesla swe makes 40% less than at Google


That's rank and file, but Tesla hires people like Andrej Karpathy and Jim Keller, are they paid low too? I bet not...


Nothing, because they don’t understand RecSys which is half of ML at social media companies. Probably could help with prediction for ads but the domains are very different.


Ad targeting at Twitter has always been shit. Also effectively deprecated. Best starting from scratch.


Printing code on paper definitely happened. Confirmed by multiple folks. The layoff 75% numbers and layoffs before Nov 1 were false though.

https://twitter.com/leahculver/status/1586145696163373056?s=...


??? The tweeter you linked printed out her code as a joke, her tweet right below this is quoting Elon, "Comedy is now legal", you taking a joke as confirmation that something happened is a great example of why twitter is a net negative on humanity.


Holy moly you should relax buster, I was joking!


Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: