Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Ask a Question
Welcome To Ask or Share your Answers For Others

Categories

Recent questions tagged floating

0 votes
459 views
1 answer
floating point - Difference between floats and ints in Javascript?
    I'm looking through some of the code from the Google Closure Library and I found this line: var isNegative = number < ... use 0.0 instead of 0? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
643 views
1 answer
floating point - losing precision converting from java BigDecimal to double
    I am working with an application that is based entirely on doubles, and am having trouble in one utility method ... exponent should be 511, no? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
349 views
1 answer
floating point - How to implement the "fast inverse square root" in Java?
    I've heard of the "fast inverse square root", discussed here, and I wanted to put it in my Java program (just for ... ). So how do you do this? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
667 views
1 answer
floating point - How to produce a NaN float in c?
    float f = (float)'a'; if(f < 0){ } else if(f == 0){ } else if(f > 0){ } else{ printf(" ... tried various ways to produce a NaN,but none work.. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
385 views
1 answer
floating point - Emulating FP64 with 2 FP32 on a GPU
    If one were to emulate double precision floating point with two single precision floating points what would the ... the performance be like? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
785 views
1 answer
floating point - How to convert from float to bigDecimal in java?
    How to convert from float to bigDecimal in java? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
516 views
1 answer
floating point - Using NaN in C++?
    What's the best way to use NaNs in C++? I found std::numeric_limits<double>::quiet_NaN() and std:: ... a floating point exception when used? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
506 views
1 answer
floating point - Good way to hash a float vector?
    I am well aware of all the problems involved in comparing floats. This is exactly the reason for this question. I'm ... I'll have to live with. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
501 views
1 answer
floating point - Float precision bits
    In this wiki article it shows 23 bits for precision, 8 for exponent, and 1 for sign Where is the hidden 24th ... 23+1) for 7 significand digits? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
476 views
1 answer
floating point - How to store more than 4 decimal places in an array in MATLAB
    I want to store 6 decimal digits into an array, but when I store it into array it only stores up to 4 decimal ... ) 0.059995 Can anyone help me? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
473 views
1 answer
floating point - Python Decimal Module - Undesired Float-Like Output?
    This I imagine is extremely simple - but why in the following are the two values for y not == 0? I thought the whole ... y) == -2.1E-19 ''' See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
791 views
1 answer
floating point - bytes convert to float (php)
    How can I convert from bytes to float in php? Like in Java int i = (byte3 & 0xff) << 24 | (byte2 & ... | byte0 & 0xff; Float.intBitsToFloat(i); See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
659 views
1 answer
floating point - Why is number divided by zero infinity in Java?
    Why should the following code in Java System.out.println(new Integer(1)/ new Double(0)); print 'Infinity' ... Isn't that mathematically wrong? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
401 views
1 answer
floating point - Representing float values in Java
    Look at the three lines of code below. float f = 1; float g = 1.1; float h = 1.1f; Second line has ... is working with suffix f. Why is this? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
943 views
1 answer
floating point - C# float bug? 0.1 - 0.1 = 1.490116E-08
    What's going on?! Subtraction works fine until I get to 0.1 - 0.1. I'm in visual c# 2008 using the ... anyway, it would never give this output. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
391 views
1 answer
floating point - Can a conversion from double to int be written in portable C
    I need to write function like double_to_int(double val, int *err) which would covert double val to integer when it' ... to support IEEE-754).? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
568 views
1 answer
floating accuracy - Integers and float precision
    This is more of a numerical analysis rather than programming question, but I suppose some of you will be able ... precision lost? Why? Thanks. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
621 views
1 answer
floating point - Maximum number of decimal digits that can affect a double
    Consider decimal representations of the form d1.d2d3d4d5...dnExxx where xxx is an arbitrary exponent and both d1 ... IEEE 754 doubles ? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
611 views
1 answer
floating point - Decimal precision of floats
    equivalent to log10(2^24) ≈ 7.225 decimal digits Wikipedia Precision: 7 digits MSDN 6 std::numeric_limits< ... 7 decimal digits of precision. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
485 views
1 answer
floating point - Float formatting in C++
    How do you format a float in C++ to output to two decimal places rounded up? I'm having no luck with setw and ... 's too much work to round up. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
476 views
1 answer
floating point - C dynamically printf double, no loss of precision and no trailing zeroes
    I'm new to C and learning out of a book / off the internet. I'm trying to write a function that I can pass any ... { break; } } return(pl); } See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
495 views
1 answer
floating point - How to Calculate Double + Float Precision
    I have been trying to find how to calculate the Floating/Double precision/range numbers -3.402823e38 .. 3. ... nothing is coming up anywhere. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
437 views
1 answer
floating point precision - Does parseDouble exist in JavaScript?
    In JavaScript, I have a number which is 21 digits, and I want to parse it. Does a parseDouble method exist in JavaScript? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
504 views
1 answer
floating point - Java double comparison epsilon
    I wrote a class that tests for equality, less than, and greater than with two doubles in Java. My general case is ... return b - a > epsilon; } See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
393 views
1 answer
floating point - What is float in Java?
    I wrote this code: float b = 3.6; and I get this: Error:Unresolved compilation problem: Type mismatch: ... ? Whats the definition of float? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
654 views
1 answer
floating point - Python float to ratio
    I try get ration of variable and get unexpected result. Can somebody explain this? >>> value = 3.2 >>> ... value.as_integer_ratio() (5, 2) See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
1.3k views
1 answer
floating point - How to manage division of huge numbers in Python?
    I have a 100 digit number and I am trying to put all the digits of the number into a list, so that I can ... in integer type, that is no floats? See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
0 votes
483 views
1 answer
floating point - Can I use the AVX FMA units to do bit-exact 52 bit integer multiplications?
    AXV2 doesn't have any integer multiplications with sources larger than 32-bit. It does offer 32 x 32 -> ... Mysticial explains in the comments. See Question&Answers more detail:os...
asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)
Page:
Ask a question:
Welcome to OStack Knowledge Sharing Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

Just Browsing Browsing

2.1m questions

2.1m answers

60 comments

57.0k users

Most popular tags

Powered by Question2Answer
Donate
Theme by Q2A Market&&OStack.cn
...