The tag has no wiki summary.

learn more… | top users | synonyms

2
votes
2answers
35 views

How to identify whether a fractional part of a number contains more that 2 digits.

EX. I want to accept numbers which have maximum of 2 digits after decimal points. i, e, 10.23 should be allowed and 10.233 should not be allowed. What mathematical operations can be done to ...
1
vote
2answers
99 views

Accurate computation of $\exp(a x^2) Q(x)$ for big values of $x$?

I was wondering how one can accurately compute the value of $\exp(a x^2) Q(b x)$ for large values of $$x \left(Q(x) \triangleq \frac{1}{\sqrt{2\pi}}\int_x^{\infty} e^{-\frac{u^2}{2}} du \right)?.$$ ...
0
votes
2answers
43 views

Find point in 3D plane

I have four points in a 3D space, example: $$(0,0,1),\ (1,0,1),\ (1,0,2)\ \mbox{and}\ (0,0,2).$$ Then I have a 2D position on that square plane: $$x = 0.5,\ y = 0.5.$$ I need to find out the 3D ...
2
votes
1answer
66 views

Quadratic Root Equation Error

Suppose a machine with the floating-point system $\beta = 10$, $p = 8$, $L = -50$, and $U = 50$ is used to calculate the roots of a quadratic equation $ax^2 + bx + c = 0$, where $a$, $b$, and $c$ ...
1
vote
1answer
44 views

Math and Taxes - Items versus Sum Total differs

First, The question is a bit confusing as I am not really sure how to word this problem as a question. The math problem I encountered which is a bit of an anomaly is this : Suppose you are ...
0
votes
1answer
66 views

Floating Point Number System

I really have no idea of how to do these questions - in fact I have no idea of how to do any question in the paper - but I have tried to figure out what's going on in the course called Computational ...
0
votes
1answer
44 views

Data Representation Question

A computer stores a number of $16$ bits word using floating-point arrangement. Given that the first bit is reserved for the sign and followed by $6$ bits for the exponent using biased form. The ...
0
votes
1answer
34 views

Multiplication of floating numbers to a modulus

As we all know, the integers follow the following identity : $$(A\cdot B\cdot C) \bmod M = ((A\cdot B) \bmod M\cdot C) \bmod M$$ But it does not work for real numbers having fractional part. For ...
0
votes
1answer
34 views

Accurate computation of KL divergence between binary RVs

I was wondering how one can compute the KL Divergence between two binary distributions (say, with parameters $p$ and $q$ and assume $p < \frac12$ and $q < \frac12$ for simplicity) accurately. ...
3
votes
0answers
48 views

How quickly can one compare exp(m/n) to a given rational?

For positive integers $\hspace{.06 in}m_{\hspace{.02 in}0}\hspace{.02 in},n_0\hspace{.02 in},m_1,n_1\:$, $\;$ how difficult is it to decide whether $$\exp\left(\hspace{-0.03 in}\frac{m_{\hspace{.02 ...
2
votes
0answers
123 views

Check for Ill Conditioned matrix

How can I efficiently check if a tridiagonal system with 1's in diagonal is ill-conditioned or not ? The common way is to get the ratio of largest and smallest singular values and see if its greater ...
1
vote
0answers
23 views

Why is this number the smallest positive normalised binary value?

In the AQA A2 Computing textbook (Bond and Langfield, 2009), they say that this number is the smallest positive normalised value, given a 10 bit mantissa and a 6 bit exponent: ...
1
vote
0answers
108 views

Division of large numbers

Euclidean Algorithm Versus Horner Algorithm. I have come across this problem and I do not manage to find a good example for it. For all the numbers I pick there is no loss. Give an example of a ...
1
vote
0answers
46 views

Displaying $2 \cdot 10^5$ as $200000$

How can I in Maple write out the number $2 \cdot 10^5$, so it displays the full number with all digits: $200000$? By typing increasing zeros I can test Maples treshold, and I get: $20$, $200$, ...
0
votes
0answers
22 views

Checking if the Hessian is the derivative of the gradient

Suppose f: R^n --> R. I have a code that computes the gradient of f. I have another code that computes the Hessian of f times a vector. Now I want to check if they are correct. Specifically, I am ...
0
votes
0answers
23 views

Heuristics for sequence convergence

Having a finite sequence of double precision floating point numbers (obtained using the fixed point iteration of a function), is there any algorithm which can be used to determine that this sequence ...
0
votes
0answers
14 views

Identity for fractional summation

I would like to know if there's an identity to represent the following summation $\sum_{i=0}^{n}\frac{x_i}{y_i}$ Where x and y are non integer values. The result of this is being calculated using ...
0
votes
0answers
41 views

What is the result of the calculation: $8.375 - 0.375-0.875$?

Given the base $\beta=2$ (binary) and $t=4$ digits to represent the number in computer with hidden bit representation and symmetric rounding, what is the result of the calculation in floating point ...
0
votes
0answers
33 views

Biased form with hidden bit

A computer stores a number of 16 bits word using floating-point arrangement. Given that the first bit is reserved for the sign and followed by 6 bits for the exponent using biased form. The remaining ...