Recent questions tagged floating

0 votes

734 views

1 answer

floating point - Javascript float subtract

I was wondering how can I subtract two negative Floating-Point numbers in javascript. I tried: alert(-0.2-0.1); and the ... to do to get -0.3 ? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

752 views

1 answer

floating point - Why does IEEE 754 reserve so many NaN values?

It seems that the IEEE 754 standard defines 16,777,214 32-bit floating point values as NaNs, or 0.4% ... find any explanation on the internet. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

824 views

1 answer

floating point - Truncate float numbers with PHP

When a float number needs to be truncated to a certain digit after the floating point, it turns out that it is not ... pow( 10, $prec ) ); } See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

719 views

1 answer

floating point - Integers in JavaScript

I'm a beginner to Javascript so forgive me if I sound dumb because I learned some Javascript from W3Fools ... of JavaScript support ints? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

615 views

1 answer

floating point - In .net, how do I choose between a Decimal and a Double

We were discussing this the other day at work and I wish there was a Stackoverflow question I would point people ... decide in the general case. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

651 views

1 answer

floating point - Is the most significant decimal digits precision that can be converted to binary and back to decimal without loss of significance 6 or 7.225?

I've come across two different precision formulas for floating-point numbers. ?(N-1) log10(2)? = 6 ... decimal without loss of significance? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

502 views

1 answer

floating point - Is there a reliable way in JavaScript to obtain the number of decimal places of an arbitrary number?

It's important to note that I'm not looking for a rounding function. I am looking for a function that ... . Hopefully I'm overthinking it. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

854 views

1 answer

floating point - Convert String to Integer/Float in Haskell?

data GroceryItem = CartItem ItemName Price Quantity | StockItem ItemName Price Quantity makeGroceryItem :: String -> ... and Int, respectively? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

793 views

1 answer

floating point - Why does a float variable stop incrementing at 16777216 in C#?

float a = 0; while (true) { a++; if (a > 16777216) break; // Will never break... a stops at ... float a = 16777217; // a becomes 16777216 See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

592 views

1 answer

floating point - Why is comparing floats inconsistent in Java?

class Test{ public static void main(String[] args){ float f1=3.2f; float f2=6.5f; if(f1==3.2){ System ... same as the result in first case. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

656 views

1 answer

floating point - Convert exponential number to decimal in php

I have a floating point number in exponential format i.e. 4.1595246940817E-17 and I want to convert it into ... seem to be working for me. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

699 views

1 answer

floating point - Java double precision sum trouble

I would like to know why I get this error. (this is Display log of Eclipse debug) var (double) 2.8 tot.getIva( ... I did not get simply 2.97! See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

702 views

1 answer

floating point - Rounding a number in Python but keeping ending zeros

I've been working on a script that takes data from an Excel spreadsheet, rounds the numbers, and removes the ... and messes with the data. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

581 views

1 answer

floating point - C: Casting minimum 32-bit integer (-2147483648) to float gives positive number (2147483648.0)

I was working on an embedded project when I ran into something which I thought was strange behaviour. I managed ... point value of 2147483648.0. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

901 views

1 answer

floating action button - How to add shadow to the FAB provided with the android support design library?

The title is pretty self explaining. The following code does not render shadow below the Floating Action ... /dandar3/android-support-design See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

623 views

1 answer

floating point - Compare two float variables in C++

I have read multiple articles regarding floating point variables comparison, but failed to understand and get the ... hold different values. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

440 views

1 answer

floating point - Why can't I compare reals in Standard ML?

Why doesn't 1.0 = 2.0 work? Isn't real an equality type? It gives the error: Error: operator and ... : Error: syntax error: inserting EQUALOP See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

489 views

1 answer

floating point - Precision in C floats

Generally we say that a float has precision of 6 digits after the decimal point. But if we store a large ... 6 digits after the decimal point? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

582 views

1 answer

floating point - How do I fix this Perl code so that 1.1 + 2.2 == 3.3?

How do I fix this code so that 1.1 + 2.2 == 3.3? What is actually happening here that's causing this ... this into a larger, existing, program? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

661 views

1 answer

floating point - Avoiding denormal values in C++

After searching a long time for a performance bug, I read about denormal floating point values. Apparently denormalized ... a float is denormal? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags