[Fixed in 348] lb5 alpha: sin differs at around 7th digit

[tsh73]

lb5 alpha: sin differs at around 7th digit

print sin(1)

print 1/3

LB5 alpha

0.84147095680237

0.33333333333333

previous version
print using("##.##############",sin(1) )

print using("##.##############",1/3 )


0.84147098480790

0.33333333333333



difference -0.2800553e-7

compared to VB.Net, Double type
0,841470984807897

difference old one and VB.Net
print 0.841470984807897 -sin(1)
0.44408921e-15

[Carl Gundel]

Interesting. I'm guessing that there's some single precision accidentally in there.

[Carl Gundel]

Feb 23, 2019 16:28:42 GMT -5 Carl Gundel said:

Interesting. I'm guessing that there's some single precision accidentally in there.

Try this.  Using scientific notation forces the double precision to come into play.

  print using("##.##############",sin(1e0) )

I don't expect this will be hard to fix.

Thanks.

[Chris Iverson]

-NUMERIC LITERAL SINGLE PRECISION NOT DOUBLE PRECISION
print sin(1) 'produces a single precision result
fixed!

Fixed in build 348. Locking.