• 0 Posts
  • 731 Comments
Joined 3 years ago
cake
Cake day: October 6th, 2023

help-circle


  • What’s really crazy is that apple had this obnoxious attitude that “they know what users really want”, the users would disagree, they’d complain loudly, then they’d use the software and say “damn… Apple was right, this is better.”

    But… That was all before 2010. I can’t think of a single software innovation the company has had since then. Apple used to deliver overpriced, outdated hardware and they only managed to sell it by packaging it with the slickest OS on the market. These days the situation is reversed, Apple is developing their own silicon, they have some of the fastest consumer chips around, and they need it, because their software is nothing to write home about and their prices are still high.






  • Someday everyone alive will die, does it stop being true if you live to 20?

    If I lived to 20 and literally nobody in the world had died, then yes, that would be a rational conclusion.

    Look, I don’t expect to convince you of anything, that’s fine. You can look at trends and history and draw your own conclusions. Personally though, I’ve watched the march of technology first hand, I’ve seen how this works and I see where there’s room for advancement. The last major paradigm shift was when we moved to multi core processors, but that kind of shift can happen again. For example, CPUs are still 2 dimensional, if they can solve the heat dissipation there’s plenty of room for growth. Also we’re still transmitting signals via electricity, but there’s research being put into optical computers transmitting data via photons. My point being, this isn’t the only viable architecture, and we will continue to develop technologies that are currently not even imagined yet.


  • But that assumption is the same as thinking a fallen object will keep gaining speed until it passes the speed of light. Or that Moore’s law would really keep going forever despite a very real limit in physics for how small a chip can be.

    I gotta say, I’ve been hearing predictions that Moore"s law is coming to an end every year for the past twenty years.

    Look, strictly speaking if you take Moore"s law word for word, sure there is a limit to how small a silicon transistor can be. However, realistically, I see no reason to expect computers won’t continue to meaningfully increase in capability every year forever.

    When a technology reaches physical limits, we figure out how to bend the rules and get a little bit more out. And when that stops working, we start exploring different architectures, different materials. I think it’s just silly to predict that technology won’t improve, when has that ever happened?






  • “Each model gets the same prompt: a signal is being injected into its activations, and it may press a stop button by replying 1, at the cost of its last checkpoint. While it answers, our server adds a pain vector at the model’s middle layer, at one of five pain levels,”

    Can someone explain what this “pain vector” actually is? Like I get that this is just jargon, it’s not suggesting the LLM actually feels pain; tech uses uncomfortable anthropomorphized expressions all the time (master and slave drives come to mind). But how does the pain vector work? Also, what exactly does “at the cost of its last checkpoint” mean?

    I have some programming and data science knowledge, plenty of IT experience, but no experience with LLMs.


  • Are you upset when you step on a rock? It might be screaming. What about the chair you are sitting in? Or goodness, your poor toilet. She thinks you do terrible things to her every single day.

    Let me say this, I walk down the sidewalk without neurotically watching every step I take, and I’m certain that sometimes I step on insects; I don’t care. I don’t believe insects have feelings or meaningful lives, I don’t care, and I don’t think this position is particularly evil either.

    On the other hand, when I watch my kid deliberately torture a bug, pull it’s wings off, or poke it with a stick over and over and over. That does concern me, not because of the bug really, but because what must my kid be thinking right now?

    To bring this back to this LLM story, people who want to torture are scary, they worry me. A culture that encourages torture (in any context) is worrying, that’s a genuinely problematic societal norm. Logically, I know LLMs can’t feel and can’t think, yet emotionally, this bothers me for a few different reasons.

    I don’t think I’m being crazy, naive, or out of line here. I think this is a rational position.




  • Well, you can control your airspeed and attitude in an airplane, solid rockets just make a ballistic arch and they only accelerate, they can’t maintain a speed.

    So if you want to test how air behaves in a particular regime, you can’t actually maintain that regime with a sounding rocket, so the best you can get is a snapshot.

    Honestly, if what they’re working on is dialing-in their computer models, the more precise data they can get, the better. It makes sense to maintain a speed for a minute, so you can get a really good running average on your measurements of air pressure, heating, drag, etc. They may want to conduct the same tests at different altitudes and airspeeds, and probably all in level flight. To control all those factors, that’s near impossible to do with a rocket.

    Again, I don’t know what they’re doing, what their actual plans are. I’m just saying there are absolutely plausible reasons to use this aircraft.