• 2 Posts
  • 75 Comments
Joined 3 years ago
cake
Cake day: June 11th, 2023

help-circle
  • Yes! The way those physics models are created is so cool. The article somewhat explains it, but it’s mostly a fluff-piece for things unrelated to genAI. More in-depth:

    The physically accurate simulation is great but slow. So we can create a neural network (there’s a huge variety in shapes), and give it an example of physics, and tell it to make a guess as to what it’ll look like in, say, 1ms. We make it improve at this billions of times, and eventually it becomes “good enough” in most cases. By doing those 1ms steps in a loop, we get a full simulation. Because we chose the shape of it, we can pick a shape that’s quite fast to compute, and now we have a less-accurate but faster simulation.

    The really cool thing is that sometimes, these models are better than the more expensive physics simulation, probably because real physics is logical and logical things are easier to learn.

    We’ve done things like this for ages. One way we can improve them is by giving them multiple time steps. Unfortunately they kinda suck at seeing connections over time, so this is expensive. Luckily, transformers were invented! This is a neural network shape that is really good at seeing connections over one dimension, like time, while still being pretty cheap and really easy to do run in parallel (which is how you can go fast nowadays).

    With a bunch of extra wiring, transformers also become GPT, i.e. text-based AIs. That’s why they suddenly got way better; they went from being able to see connections with words maybe 3-4 steps back, to recently a literal million. This is basically the only relationship with “AI” this has.








  • Sekoia@lemmy.blahaj.zonetolinuxmemes@lemmy.worldhehehe
    link
    fedilink
    arrow-up
    21
    arrow-down
    1
    ·
    1 year ago

    Ngl that’s actually a pretty cute apartment. The desk setup is really nice (standing desk, hidden cabling for the screens), everything is clean. The shelf on top with the hourglass and the record player on the right are nice decorations. I wanna live here





  • Sekoia@lemmy.blahaj.zonetomemes@lemmy.worldAI sucks
    link
    fedilink
    arrow-up
    26
    arrow-down
    1
    ·
    1 year ago

    It’s (genuinely) interesting that big-time AI enthusiasts always assume that if you dislike AI, it’s because you don’t know how to use it (and not because they have different priorities or have conceptual issues with it or such). It was the same thing with crypto and NFTs.

    I know a good amount of very skilled developers who tried AI several times in different contexts, and always found the tradeoffs much too bad to be worth it (in terms of accuracy, precision, cost, speed, whatever), and yet they still get “oh you just haven’t tried my favorite AI tool”.