Jason figured it out!?
All of the data centers in the US combined use 4% of total electric load.
I’ll try it out! It’s been a hot minute, and it seems like there are new options all the time.
Yeah, I’ve had decent results running the 7B/8B models, particularly the fine tuned ones for specific use cases. But as ya mentioned, they’re only really good in thier scope for a single prompt or maybe a few follow-ups. I’ve seen little improvement with the 13B/14B models and find them mostly not worth the performance hit.
All of the data centers in the US combined use 4% of total electric load.
Then again, the US and China are basically the only players in this “game” atm. Hugging Face is trying hard to get the EU on-boarded, and I’m sure we’ll see more contenders. But right now it’s a 2-player game.
It’s probably a vision model (like this) with custom instructions that direct it to focus on those factors. It’d be interesting to see the instructions.
I think it’s more likely a compound sigmoid (don’t Google that). LLMs are composed of distinct technologies working together. As we’ve reached the inflection point of the scaling for one, we’ve pivoted implementations to get back on track. Notably, context windows are no longer an issue. But the most recent pivot came just this week, allowing for a huge jump in performance. There are more promising stepping stones coming into view. Is the exponential curve just a series of sigmoids stacked too close together? In any case, the article’s correct - just adding more compute to the same exact implementation hasn’t enabled scaling exponentially.
There used to be very real hardware reasons that upload had much lower bandwidth. I have no idea if there still are.
President Biden included funding to expand the Community Eligibility Provision (CEP) in the his Fiscal Year 2024 budget.
The budget earmarks over $15 billion in funds to allow more school districts to take advantage of CEP, which allows schools that have a high percentage of low-income students serve universal free meals.
The White House has advocated for the expansion of universal free meals at school and aims to provide free school meals to 9 million more students by 2032 as part of its National Strategy on Hunger, Nutrition and Health. [March 2023]
They also apparently made them more nutritious.
Reduction in access to abortion and contraceptives will only increase the number of people in this country struggling to feed kids. We could also talk about school lunch programs and support services in general.
Well yeah, but it’s not like they haven’t tried. I’ve certainly been frustrated watching the DNC try for decades to get some version of progressive policy passed only to succeed in the most compromised ways. But usually the reason is simply Americans. My office mate is certain that Jesus is coming back soon. What do you do with that?
S’all about getting yours, eh?
Didn’t have any student debt?
Ditto, I was about to start waxing poetic about my bard.
I appreciate the sources and the rigor. But is it not the left that’s consistently pushing for a higher minimum wage? For exploring solutions like UBI or even just expanded social safety nets for the people who fall out the bottom?
The costs of healthcare continues to skyrocket, when we’re already paying twice what other nations are. Healthcare bills are a leading cause of bankruptcy. But is it not the left (sorry, I started the “is it not” thing, and I feel like I need to keep it going, ahem…) that’s been pushing universal healthcare? For transparency in hospital costs?
I’m just saying that I don’t think it’s accurate to say the DNC has “abandoned the working class.” The DNC’s never been able to communicate effectively (or perhaps they’ve just never been believed) when they try to explain that they haven’t abandoned the working class. And they’re not very good at fellating microphones.
Do people mean anything other than commodity and gas prices when they say “working class issues?” I feel like abortion, healthcare, education, and student loans are also working class issues, but I take it that’s not what people mean.
Yeah, but they encourage confining it to a virtual machine with limited access.