Recent questions tagged Floating

0 votes

455 views

1 answer

floating point - Difference between floats and ints in Javascript?

I'm looking through some of the code from the Google Closure Library and I found this line: var isNegative = number < ... use 0.0 instead of 0? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

641 views

1 answer

floating point - losing precision converting from java BigDecimal to double

I am working with an application that is based entirely on doubles, and am having trouble in one utility method ... exponent should be 511, no? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

345 views

1 answer

floating point - How to implement the "fast inverse square root" in Java?

I've heard of the "fast inverse square root", discussed here, and I wanted to put it in my Java program (just for ... ). So how do you do this? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

657 views

1 answer

floating point - How to produce a NaN float in c?

float f = (float)'a'; if(f < 0){ } else if(f == 0){ } else if(f > 0){ } else{ printf(" ... tried various ways to produce a NaN,but none work.. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

381 views

1 answer

floating point - Emulating FP64 with 2 FP32 on a GPU

If one were to emulate double precision floating point with two single precision floating points what would the ... the performance be like? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

778 views

1 answer

floating point - How to convert from float to bigDecimal in java?

How to convert from float to bigDecimal in java? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

505 views

1 answer

floating point - Using NaN in C++?

What's the best way to use NaNs in C++? I found std::numeric_limits<double>::quiet_NaN() and std:: ... a floating point exception when used? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

501 views

1 answer

floating point - Good way to hash a float vector?

I am well aware of all the problems involved in comparing floats. This is exactly the reason for this question. I'm ... I'll have to live with. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

497 views

1 answer

floating point - Float precision bits

In this wiki article it shows 23 bits for precision, 8 for exponent, and 1 for sign Where is the hidden 24th ... 23+1) for 7 significand digits? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

467 views

1 answer

floating point - How to store more than 4 decimal places in an array in MATLAB

I want to store 6 decimal digits into an array, but when I store it into array it only stores up to 4 decimal ... ) 0.059995 Can anyone help me? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

472 views

1 answer

floating point - Python Decimal Module - Undesired Float-Like Output?

This I imagine is extremely simple - but why in the following are the two values for y not == 0? I thought the whole ... y) == -2.1E-19 ''' See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

775 views

1 answer

floating point - bytes convert to float (php)

How can I convert from bytes to float in php? Like in Java int i = (byte3 & 0xff) << 24 | (byte2 & ... | byte0 & 0xff; Float.intBitsToFloat(i); See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

654 views

1 answer

floating point - Why is number divided by zero infinity in Java?

Why should the following code in Java System.out.println(new Integer(1)/ new Double(0)); print 'Infinity' ... Isn't that mathematically wrong? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

397 views

1 answer

floating point - Representing float values in Java

Look at the three lines of code below. float f = 1; float g = 1.1; float h = 1.1f; Second line has ... is working with suffix f. Why is this? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

941 views

1 answer

floating point - C# float bug? 0.1 - 0.1 = 1.490116E-08

What's going on?! Subtraction works fine until I get to 0.1 - 0.1. I'm in visual c# 2008 using the ... anyway, it would never give this output. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

387 views

1 answer

floating point - Can a conversion from double to int be written in portable C

I need to write function like double_to_int(double val, int *err) which would covert double val to integer when it' ... to support IEEE-754).? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

556 views

1 answer

floating accuracy - Integers and float precision

This is more of a numerical analysis rather than programming question, but I suppose some of you will be able ... precision lost? Why? Thanks. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

618 views

1 answer

floating point - Maximum number of decimal digits that can affect a double

Consider decimal representations of the form d1.d2d3d4d5...dnExxx where xxx is an arbitrary exponent and both d1 ... IEEE 754 doubles ? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

608 views

1 answer

floating point - Decimal precision of floats

equivalent to log10(2^24) ≈ 7.225 decimal digits Wikipedia Precision: 7 digits MSDN 6 std::numeric_limits< ... 7 decimal digits of precision. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

481 views

1 answer

floating point - Float formatting in C++

How do you format a float in C++ to output to two decimal places rounded up? I'm having no luck with setw and ... 's too much work to round up. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

472 views

1 answer

floating point - C dynamically printf double, no loss of precision and no trailing zeroes

I'm new to C and learning out of a book / off the internet. I'm trying to write a function that I can pass any ... { break; } } return(pl); } See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

491 views

1 answer

floating point - How to Calculate Double + Float Precision

I have been trying to find how to calculate the Floating/Double precision/range numbers -3.402823e38 .. 3. ... nothing is coming up anywhere. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

428 views

1 answer

floating point precision - Does parseDouble exist in JavaScript?

In JavaScript, I have a number which is 21 digits, and I want to parse it. Does a parseDouble method exist in JavaScript? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

500 views

1 answer

floating point - Java double comparison epsilon

I wrote a class that tests for equality, less than, and greater than with two doubles in Java. My general case is ... return b - a > epsilon; } See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

389 views

1 answer

floating point - What is float in Java?

I wrote this code: float b = 3.6; and I get this: Error:Unresolved compilation problem: Type mismatch: ... ? Whats the definition of float? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

649 views

1 answer

floating point - Python float to ratio

I try get ration of variable and get unexpected result. Can somebody explain this? >>> value = 3.2 >>> ... value.as_integer_ratio() (5, 2) See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

1.3k views

1 answer

floating point - How to manage division of huge numbers in Python?

I have a 100 digit number and I am trying to put all the digits of the number into a list, so that I can ... in integer type, that is no floats? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

475 views

1 answer

floating point - Can I use the AVX FMA units to do bit-exact 52 bit integer multiplications?

AXV2 doesn't have any integer multiplications with sources larger than 32-bit. It does offer 32 x 32 -> ... Mysticial explains in the comments. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags