Author Topic: Any Reason This Shouldn't Work?  (Read 4072 times)

0 Members and 1 Guest are viewing this topic.

Offline ztrumpet

  • The Rarely Active One
  • CoT Emeritus
  • LV13 Extreme Addict (Next: 9001)
  • *
  • Posts: 5712
  • Rating: +364/-4
  • If you see this, send me a PM. Just for fun.
    • View Profile
Re: Any Reason This Shouldn't Work?
« Reply #30 on: October 06, 2010, 07:38:01 pm »
Never mind, my code failed. :(

Offline meishe91

  • Super Ninja
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2946
  • Rating: +115/-11
    • View Profile
    • DeviantArt
Re: Any Reason This Shouldn't Work?
« Reply #31 on: October 06, 2010, 07:40:05 pm »
What was it supposed to do?
Spoiler For Spoiler:



For the 51st time, that is not my card! (Magic Joke)

Offline ztrumpet

  • The Rarely Active One
  • CoT Emeritus
  • LV13 Extreme Addict (Next: 9001)
  • *
  • Posts: 5712
  • Rating: +364/-4
  • If you see this, send me a PM. Just for fun.
    • View Profile
Re: Any Reason This Shouldn't Work?
« Reply #32 on: October 06, 2010, 07:44:07 pm »
Fail. :(
No, it was to demonstrate floating point rounding errors.  It was simple enough that it didn't work.  It should work now. :)  (Edited)

Offline Deep Toaster

  • So much to do, so much time, so little motivation
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 8206
  • Rating: +758/-15
    • View Profile
    • ClrHome
Re: Any Reason This Shouldn't Work?
« Reply #33 on: October 06, 2010, 07:45:26 pm »
Yeah, the calc only shows 11 digits of accuracy, while it really holds 14 :)




Offline meishe91

  • Super Ninja
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2946
  • Rating: +115/-11
    • View Profile
    • DeviantArt
Re: Any Reason This Shouldn't Work?
« Reply #34 on: October 06, 2010, 11:49:50 pm »
Isn't the error only in the decimal places? Like if you have a fourteen digit number shouldn't it retain those?
Spoiler For Spoiler:



For the 51st time, that is not my card! (Magic Joke)

Offline Deep Toaster

  • So much to do, so much time, so little motivation
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 8206
  • Rating: +758/-15
    • View Profile
    • ClrHome
Re: Any Reason This Shouldn't Work?
« Reply #35 on: October 06, 2010, 11:54:03 pm »
Yeah. But the point is fPart( often leaves that extra bit of inaccuracy which isn't displayed. They're a pain to debug x.x




Offline meishe91

  • Super Ninja
  • LV11 Super Veteran (Next: 3000)
  • ***********
  • Posts: 2946
  • Rating: +115/-11
    • View Profile
    • DeviantArt
Re: Any Reason This Shouldn't Work?
« Reply #36 on: October 06, 2010, 11:56:03 pm »
Ya, I know, was just making sure :) Thanks again guys.
Spoiler For Spoiler:



For the 51st time, that is not my card! (Magic Joke)

Offline DJ Omnimaga

  • Former TI programmer
  • CoT Emeritus
  • LV15 Omnimagician (Next: --)
  • *
  • Posts: 55838
  • Rating: +3151/-232
  • CodeWalrus founder & retired Omnimaga founder
    • View Profile
    • DJ Omnimaga Music
Re: Any Reason This Shouldn't Work?
« Reply #37 on: October 07, 2010, 12:05:54 am »
Yeah. But the point is fPart( often leaves that extra bit of inaccuracy which isn't displayed. They're a pain to debug x.x
That reminds me this topic. Is it the same thing?
In case you are wondering where I went, I left Omni back in 2015 to form CodeWalrus due to various reasons explained back then, but I stopped calc dev in 2016 and am now mostly active on the CW Discord server at https://discord.gg/cuZcfcF



Official Website |T-Shirt store | Reverbnation | Facebook | Youtube | Twitter | Spotify

Offline Deep Toaster

  • So much to do, so much time, so little motivation
  • Administrator
  • LV13 Extreme Addict (Next: 9001)
  • *************
  • Posts: 8206
  • Rating: +758/-15
    • View Profile
    • ClrHome
Re: Any Reason This Shouldn't Work?
« Reply #38 on: October 07, 2010, 12:18:50 am »
It seems to be...