• 8 Posts
  • 104 Comments
Joined 2 years ago
cake
Cake day: October 4th, 2023

help-circle



  • The issues run deeper, Kaas Elias explained, than just these most recent cuts. “Unfortunately, the federal government has taken a step backward when it comes to public transport,” he said. For example, the Deutschlandticket for regional public transport across the country has transformed from a €9 a month COVID-19 era mega-success to €63 a month as of January 2026.

    If I remember correctly back when that was announced, and there was some discussion on Reddit about it, that was intended from the beginning to be a temporary program.

    searches

    https://en.wikipedia.org/wiki/Deutschlandticket

    The Deutschlandticket (Deutschlandticket, lit. ‘Germany ticket’), also known as the D-Ticket, is a monthly subscription for local and regional public transport valid throughout Germany. It was introduced in May 2023 by the Scholz cabinet as the successor to the temporary 9-Euro-Ticket offered in summer 2022.

    WP says it was temporary too.


  • You mean just the brand, or the manufacturing?

    I mean, branding something is trivial.

    But if you want to manufacture it in Europe, then you have to compete against companies who are going to be manufacturing in China, and manufacturing wages are going to be lower in China, so it’s going to be at a price disadvantage.

    I was just commenting yesterday where some guy wanted to buy a keyboard out of the EU or Canada instead of a Unicomp keyboard because he was pissed at the US. He was asking about buying a Cherry keyboard. Cherry just shut down their production in Germany after cheaper Chinese competition clobbered 'em.

    If you want to have stuff manufactured in Europe, you’ve got kinda limited options.

    1. Get some kind of patriotic “buy European” thing going, where people are intrinsically willing to pay a premium for things made in Europe.

    2. Ban imports. My guess is that in general, Europe will not do this unless they have some negative externality, like national security, associated with the import (think, say, Russian natural gas), since it’s economically-inefficient.

    3. Leverage some kind of other comparative advantage. Like, okay. Maybe one can’t have competitive unskilled assembly line workers. But maybe if there’s really amazing, world-leading industrial automation, so that there’s virtually no human labor marginal cost involved, and one scales production way up, it’s possible to eliminate enough of the assembly line labor costs to be competitive.



  • Unless you have some really serious hardware, 24 billion parameters is probably the maximum that would be practical for self-hosting on a reasonable hobbyist set-up.

    Eh…I don’t know if you’d call it “really serious hardware”, but when I picked up my 128GB Framework Desktop, it was $2k (without storage), and that box is often described as being aimed at the hobbyist AI market. That’s pricier than most video cards, but an AMD Radeon RX 7900 XTX GPU was north of $1k, an NVidia RTX 4090 was about $2k, and it looks like the NVidia RTX 5090 is presently something over $3k (and rising) on EBay, well over MSRP. None of those GPUs are dedicated hardware aimed at doing AI compute, just high-end cards aimed at playing games that people have used to do AI stuff on.

    I think that the largest LLM I’ve run on the Framework Desktop was a 106 billion parameter GLM model at Q4_K_M quantization. It was certainly usable, and I wasn’t trying to squeeze as large a model as possible on the thing. I’m sure that one could run substantially-larger models.

    EDIT: Also, some of the newer LLMs are MoE-based, and for those, it’s not necessarily unreasonable to offload expert layers to main memory. If a particular expert isn’t being used, it doesn’t need to live in VRAM. That relaxes some of the hardware requirements, from needing a ton of VRAM to just needing a fair bit of VRAM plus a ton of main memory.


  • That’s why they have the “Copilot PC” hardware requirement, because they’re using an NPU on the local machine.

    searches

    https://learn.microsoft.com/en-us/windows/ai/npu-devices/

    Copilot+ PCs are a new class of Windows 11 hardware powered by a high-performance Neural Processing Unit (NPU) — a specialized computer chip for AI-intensive processes like real-time translations and image generation—that can perform more than 40 trillion operations per second (TOPS).

    It’s not…terribly beefy. Like, I have a Framework Desktop with an APU and 128GB of memory that schlorps down 120W or something, substantially outdoes what you’re going to do on a laptop. And that in turn is weaker computationally than something like the big Nvidia hardware going into datacenters.

    But it is doing local computation.


  • I’m kind of more-sympathetic to Microsoft than to some of the other companies involved.

    Microsoft is trying to leverage the Windows platform that they control to do local LLM use. I’m not at all sure that there’s actually enough memory out there to do that, or that it’s cost-effective to put a ton of memory and compute capacity in everyone’s home rather than time-sharing hardware in datacenters. Nor am I sold that laptops — which many “Copilot PCs” are — are a fantastic place to be doing a lot of heavyweight parallel compute.

    But…from a privacy standpoint, I kind of would like local LLMs to be at least available, even if they aren’t as affordable as cloud-based stuff. And at least Microsoft is at least supporting that route. A lot of companies are going to be oriented towards just doing AI stuff in the cloud.


  • You only need one piece of (timeless) advice regarding what to look for, really: if it looks too good to be true, it almost certainly is. Caveat emptor.

    I mean…normally, yes, but because the situation has been changing so radically in such a short period of time, it probably is possible to get some bonkers deals in various niches, because the market hasn’t stabilized yet.

    Like, a month and a half back, in early December, when prices had only been going up like crazy for a little while, I was posting some tiny retailers that still had RAM in stock at pre-price-increase rates that I could find on Google Shopping. IIRC the University of Virginia bookstore was one, as they didn’t check that purchasers were actually students. I warned that they’d probably be cleaned out as soon as scalpers got to them, and that if someone wanted memory, they should probably get it ASAP. Some days prior to that, there was a small PC parts store in Hawaii that had some (though that was out of stock by the next time I was looking and mentioned the bookstore).

    That’s not to disagree with the point that @UnderpantsWeevil@lemmy.world is making, that this was awfully sketchy as a source, or your point that scavenging components off even a non-scam piece of secondhand non-functional hardware is risky. But in times of rapid change, it’s not impossible to find deals. In fact, it’s various parties doing so that cause prices to stabilize — anyone selling memory for way below market price is going to have scalpers grab it.



  • I’m not really a hardware person, but purely in terms of logic gates, making a memory circuit isn’t going to be hard. I mean, a lot of chips contain internal memory. I’m sure that anyone that can fabricate a chip can fabricate someone’s memory design that contains some amount of memory.

    For PC use, there’s also going to be some interface hardware. Dunno how much sophistication is present there.

    I’m assuming that the catch is that it’s not trivial to go out and make something competitive with what the PC memory manufacturers are making in price, density, and speed. Like, I don’t think that if you want to get a microcontroller with 32 kB of onboard memory, that it’s going to be a problem. But that doesn’t really replace the kind of stuff that these guys are making.

    EDIT: The other big thing to keep in mind is that this is a short-term problem, even if it’s a big problem. I mean, the problem isn’t the supply of memory over the long term. The problem is the supply of memory over the next couple of years. You can’t just build a factory and hire a workforce and get production going the moment that someone decides that they want several times more memory than the world has been producing to date.

    So what’s interesting is really going to be solutions that can produce memory in the near term. Like, I have no doubt that given years of time, someone could set up a new memory manufacturer and facilities. But to get (scaled-up) production in a year, say? Fewer options there.





  • I don’t understand how “gamer style” is a thing.

    Like, in general? Lots of non-functional molded plastic angular stuff with unnecessary holes, crevices, lights, and styling slapped on stuff. Let me do a quick search for “gamer mouse”.

    searches

    Yeah. That’s a nice example.

    The ROG Phone itself isn’t a particularly over-the-top example of that, but I don’t really want the styling.

    It isn’t a deal-breaker, just that I’d rather not have it; for me it was a negative.

    If you’re old enough to remember Winamp skins from the early 2000s

    I am, and I agree that many of those did have similar over-the-top styling…and I don’t want to buy physical hardware that looks like it.

    I generally just want understated hardware without a lot of styling on it on all my computer hardware. I’m sure that there are people who do want something that looks more like the above, and that’s fine, but it’s not an aesthetic that I personally much like.


  • If I had to guess, part of the problem is probably “bigger” hardware moving into their space.

    Like, phones have a lot of limitations for playing “heavyweight”, PC-style games:

    • Small battery.

    • Small screen.

    • Limited ability to dissipate heat.

    • Really limited space and the hardware tradeoffs that come with that.

    • Touchscreen controls, even with accelerometer, aren’t ideal for a lot of games, especially PC or console ports.

    For a lot of those, if you can manage to lug a laptop with you, you’re probably better off.

    Then you have stuff like the Steam Deck and a bunch of similar larger-than-phone game-oriented platforms show up, and that eats even further into your market. Yeah, okay, a ROG Phone is smaller and lighter than a Steam Deck, but if you’re trying to deal with touchscreen controls by lugging along external control stuff, then you’re sacrificing some of that mobility:

    https://www.androidcentral.com/phones/asus-rog-phone-9-pro-is-the-best-gaming-phone-and-its-here-in-the-us

    I mean, I’m sure that there’s still a niche for heavyweight-game phone gaming, but it’s gonna have other parties eating away at the edges, narrowing it. You gotta want to play heavyweight games, not be willing to use larger-than-phone hardware, but spend a substantial amount of money on your phone (especially given the short EOL on the ROG phone) to have that ability. My guess is that some people who won’t use other hardware for gaming is because they have a phone and are price-sensitive enough to not want to get additional hardware platforms to just play games, so “users willing to spend a high premium on phone hardware to be able to game” may be a poor match to that market.



  • American importers and consumers bear nearly the entire cost. Foreign exporters absorb only about 4% of the tariff burden—the remaining 96% is passed through to US buyers.

    Yes.

    The 2025 US tariffs are an own goal

    No, not from the standpoint of the administration.

    They want to shift taxes from the wealthy to the poor. That’s what a fair bit of the administration’s policy has been focused on. Tariffs are more-or-less functionally a consumption tax, which is regressive, hits the poor more-heavily than the wealthy.

    But Trump said that foreign exporters will pay the tax!

    Sure. Shifting taxes from the wealthy to the poor is probably not going to sell politically very well.

    If Trump and company announced a national sales tax, which would also be regressive, they’d probably be in hot water politically. Instead, he’s announcing a tax where it’s less-clear who is paying, since it just generates higher prices that aren’t clearly linked to the government, and then insisting that the public isn’t being taxed.