• 0 Posts
  • 114 Comments
Joined 2 years ago
cake
Cake day: February 16th, 2025

help-circle







  • I dunno why everyone always jumps to accusations like this.

    Well, I can’t speak to everyone, but I jumped to that conclusion because you proposed the idea that the current top of the line models are simply big fat transformers and nothing else.

    I’m really glad to hear that you’ve had your fingers in the pie, and have a good grasp of what an LLM is and what it does on a mechanical level. It makes talking about them much easier. I’m super cool with continuing a discussion if you are interested in why I think they are an integral part of eventual AGI.

    To clarify, I do not think that their current form is a 1:1. I disagree with your blimp analogy though. I think a better comparison would be an internal combustion engine. It’s certainly not a turbofan engine or a scramjet, but the basic concept is there.

    Turning language into a fuzzy world model that can be interfaced with simply, and performing math on that model, is just as important to AGI as a fully fleshed out physics simulation is for AGI. Humans have both. Why would an AGI not need them?

    What an LLM does to it’s array is not “intelligence”. It’s simple math. However, it is performed on a thing so complex that it cannot be derived from any math we have now, a manifold created through eons of interface between all humans and the universe.

    The “magic” isn’t in the simple math, it’s in the thing we all made together for millions of years. An interface with this, even one as “simple” as an autoregressive transformer, is an indespensible part of AGI, both because it provides a fuzzy way to understand the universe, and because it provides an interface with humanity, and humanity processes the universe in a way that is so complex, computers will not be able to emulate it for generations.

    Edit: also, fuck altman and musk and zuck and even amodei. I wouldn’t trust anything they say either.



  • Transformers are only a part of AGI, just like “saying the most logical next word” is only a part of the human mind. Transformers, which need not be used exclusively on language, are a great way to dial in successful actions from the infinity of possibility. They are not a great way of vetting those actions before you implement them. They are a necessary part of AGI, just like the human use of language was a necessary part of us getting to the era of space ships.

    I don’t think investors are being sold the idea that infinite scaling transformers are the end of the road. From what I’ve seen, anthropic and openai have both been desperately trying to add systems to their transformers to make them more capable, while also continuing to scale transformers to find out where that particular technology plateaus. This has been their path since GPT4 was released.

    I think your assessment is an extreme oversimplification which naturally looks like it will fail because you left out 90% of what is going on. Are you only following the media meant for the general public, and the PR statements from AI companies? Like most scientific or businesses endeavors, that’s been dumbed down to the point of being useless, just so the average person can understand what’s happening, or is simply advertising.


  • My mistake if I came off as implying that it’s going to succeed. I was just giving flavor to the dynamics of what is actually happening.

    As for “this is all of human history”, I’d say that the rich are indeed always trying to build a moat that others cannot cross, from within which they can make money off of the spoils of their exploitation and destruction.

    I would not agree that they have always been trying to “build the tower of Babel”. I think this latest venture into AI represents an attempted colonization of thinking in the same way that mechanization represented a colonization of labor.

    I think that what is happening now, whether it succeeds at making ASI or not, represents just as much a disruption to the way people interact with nature, eachother, and “the market” as mechanization did. Almost everyone senses this too.

    Even in the AI haters imaginings, it completely disrupts things. If they really thought it would all fail, they wouldn’t be fighting, only laughing. They’re really worried it will “succeed” and everything will just be creatively devoid of meaning while they are simultaneously denied access to the capital required to create $100,000,000 media pieces or even a yearly salary for creating art for capitalist use.

    The only difference in the pro AI people is that they think it will be just as creatively fulfilling as human art, and that they will get to keep the $100,000,000 themselves and everyone’s yearly salary.

    Personally, I think that if you can put a person in meat, you can put a person in silicon. I’d like to separate my “theories” from fact though, and above I was just stating the barest most overt facts. If you’d like to discuss the possibilities and the whispers at the edges of things, I’m more than happy to do that below.




  • These public-facing models are not the thing that convinces people with money to play ball.

    The plan is not to have the AI eventually reach profitability through payments from the general public, or even by performing massive amounts of physical labor for companies. The plan is to have the smartest being on Earth outsmart every other living thing, in perpetuity.

    Yes, this is a ponzi scheme right now. Yes, profits are being funded by investors. But the endgame was never “everyone gives us $20 a month”, or even “Amazon pays us to run its robots”. Those are ideas fed to the general public to keep them from destroying the data centers in terror.

    The plan is for their AI to be able to buy stocks before they go up, patent things before they are needed, and run endgame around everyone’s desires, including world leaders and other business men, so they can be controlled like a man controls a dog.

    They are trying to make the last thing man need ever make, and that is what the big investors and the CEOs of companies passing around the same bags of money, are doing. As such, this bubble can and will continue until either they birth the sand god or the big money people and world leaders stop being convinced by the private, non public facing models, that the sand god is possible.


  • Biden and trump both hugely emptied the reserves for short-term gain, without putting very much, if any, back. Like any company that has been bought-out by corporate raiders, the US has ruined its name for short term gain and is now being parted out. The next decade or 3 will be like living in a mining town after the mine leaves it a superfund site, from coast to coast. Perhaps a few large cities will survive with only deep scars.






  • Yeah, they’re fucking bonkers over there. I absolutely do not toe the line for America, but .ml people repeatedly accused me of being a chauvinist even as I was actively bad mouthing the country, because I called them out on this exact topic of “the tanmen square adjacent massacre”. It was

    • my first back and forth interaction on .ml
    • where I learned about this weird “ackshully there was no massacre IN tianmen square” tactic
    • my permaban from .ml for calling it out
    • why I never have to worry about their bonkers instance in my feed

    All in all, they gave me a great gift. I wasted a total of 20 minutes or so with them, and then they gave me a boon that lasts forever. I’m pretty sure it’s like mirror universe /pol/, a limited hangout for billionaire social control reasons.