• AdrianTheFrog@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      3 days ago

      Better calculators just use floating point math with a few tricks on top to pretend it isn’t floating point math.

    • Squibbles@lemmy.ca
      link
      fedilink
      arrow-up
      6
      ·
      3 days ago

      Weirdly though it wasn’t remotely close to the right answer so I don’t think it was floating point malarkey. I always assumed some defect but I guess we’ll never know.now I wish I had kept it so I could have sent it to Matt Parker for his calculator reviews