Recent questions tagged Floating

0 votes

749 views

1 answer

floating point - Javascript float subtract

I was wondering how can I subtract two negative Floating-Point numbers in javascript. I tried: alert(-0.2-0.1); and the ... to do to get -0.3 ? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

760 views

1 answer

floating point - Why does IEEE 754 reserve so many NaN values?

It seems that the IEEE 754 standard defines 16,777,214 32-bit floating point values as NaNs, or 0.4% ... find any explanation on the internet. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

844 views

1 answer

floating point - Truncate float numbers with PHP

When a float number needs to be truncated to a certain digit after the floating point, it turns out that it is not ... pow( 10, $prec ) ); } See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

728 views

1 answer

floating point - Integers in JavaScript

I'm a beginner to Javascript so forgive me if I sound dumb because I learned some Javascript from W3Fools ... of JavaScript support ints? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

619 views

1 answer

floating point - In .net, how do I choose between a Decimal and a Double

We were discussing this the other day at work and I wish there was a Stackoverflow question I would point people ... decide in the general case. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

657 views

1 answer

floating point - Is the most significant decimal digits precision that can be converted to binary and back to decimal without loss of significance 6 or 7.225?

I've come across two different precision formulas for floating-point numbers. ?(N-1) log10(2)? = 6 ... decimal without loss of significance? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

506 views

1 answer

floating point - Is there a reliable way in JavaScript to obtain the number of decimal places of an arbitrary number?

It's important to note that I'm not looking for a rounding function. I am looking for a function that ... . Hopefully I'm overthinking it. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

861 views

1 answer

floating point - Convert String to Integer/Float in Haskell?

data GroceryItem = CartItem ItemName Price Quantity | StockItem ItemName Price Quantity makeGroceryItem :: String -> ... and Int, respectively? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

797 views

1 answer

floating point - Why does a float variable stop incrementing at 16777216 in C#?

float a = 0; while (true) { a++; if (a > 16777216) break; // Will never break... a stops at ... float a = 16777217; // a becomes 16777216 See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

597 views

1 answer

floating point - Why is comparing floats inconsistent in Java?

class Test{ public static void main(String[] args){ float f1=3.2f; float f2=6.5f; if(f1==3.2){ System ... same as the result in first case. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

666 views

1 answer

floating point - Convert exponential number to decimal in php

I have a floating point number in exponential format i.e. 4.1595246940817E-17 and I want to convert it into ... seem to be working for me. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

712 views

1 answer

floating point - Java double precision sum trouble

I would like to know why I get this error. (this is Display log of Eclipse debug) var (double) 2.8 tot.getIva( ... I did not get simply 2.97! See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

710 views

1 answer

floating point - Rounding a number in Python but keeping ending zeros

I've been working on a script that takes data from an Excel spreadsheet, rounds the numbers, and removes the ... and messes with the data. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

587 views

1 answer

floating point - C: Casting minimum 32-bit integer (-2147483648) to float gives positive number (2147483648.0)

I was working on an embedded project when I ran into something which I thought was strange behaviour. I managed ... point value of 2147483648.0. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

912 views

1 answer

floating action button - How to add shadow to the FAB provided with the android support design library?

The title is pretty self explaining. The following code does not render shadow below the Floating Action ... /dandar3/android-support-design See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

633 views

1 answer

floating point - Compare two float variables in C++

I have read multiple articles regarding floating point variables comparison, but failed to understand and get the ... hold different values. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

446 views

1 answer

floating point - Why can't I compare reals in Standard ML?

Why doesn't 1.0 = 2.0 work? Isn't real an equality type? It gives the error: Error: operator and ... : Error: syntax error: inserting EQUALOP See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

495 views

1 answer

floating point - Precision in C floats

Generally we say that a float has precision of 6 digits after the decimal point. But if we store a large ... 6 digits after the decimal point? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

591 views

1 answer

floating point - How do I fix this Perl code so that 1.1 + 2.2 == 3.3?

How do I fix this code so that 1.1 + 2.2 == 3.3? What is actually happening here that's causing this ... this into a larger, existing, program? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

673 views

1 answer

floating point - Avoiding denormal values in C++

After searching a long time for a performance bug, I read about denormal floating point values. Apparently denormalized ... a float is denormal? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags