I'm not the best at math(but eager to learn) so please excuse me if I'm not explaining this problem correctly, I will try to add as much info to make it clear. I basically receive 2 pieces of data, one is a list of integers and the other is a target_sum, and I want to figure out all the ways I can use the list to equal the target sum. So for a list of [1,2,4] to a target_sum of 10, I would get:

2 * 4 +  1 * 2 +  0 * 1
2 * 4 +  0 * 2 +  2 * 1
1 * 4 +  3 * 2 +  0 * 1
1 * 4 +  2 * 2 +  2 * 1
1 * 4 +  1 * 2 +  4 * 1
1 * 4 +  0 * 2 +  6 * 1
0 * 4 +  5 * 2 +  0 * 1
0 * 4 +  4 * 2 +  2 * 1
0 * 4 +  3 * 2 +  4 * 1
0 * 4 +  2 * 2 +  6 * 1
0 * 4 +  1 * 2 +  8 * 1
0 * 4 +  0 * 2 + 10 * 1

The current algorithm I'm using is two parts, one builds a look up table of what combinations are possible and the other builds the actual table: Table building:

for i = 1 to k
    for z = 0 to sum:
        for c = 1 to z / x_i:
            if T[z - c * x_i][i - 1] is true:
                set T[z][i] to true

Possibility construction:

function RecursivelyListAllThatWork(k, sum) // Using last k variables, make sum
    /* Base case: If we've assigned all the variables correctly, list this
     * solution.
    if k == 0:
        print what we have so far

    /* Recursive step: Try all coefficients, but only if they work. */
    for c = 0 to sum / x_k:
       if T[sum - c * x_k][k - 1] is true:
           mark the coefficient of x_k to be c
           call RecursivelyListAllThatWork(k - 1, sum - c * x_k)
           unmark the coefficient of x_k

This is the basic idea, my actual code is a slightly different because I am using bounds to remove the possibility of infinite values(I say a single value cannot exceed the value of the sum).

The problem is, the table building part does not scale. It is flawed in, at least two ways, one is its dependent on the previous number to be completed(thus I cannnot break it and run it individually for each number) and the second problem is it requires to read a table before it writes(I am learning about how to get around this technically but currently it makes the program very slow).

Is there a more efficient way to do this that scales?

Here's an approach I tried to take but failed(so far):

create a large table full of all possible values.z to target_sum..
create another large table of T[z - c * x_i][i - 1] and compare if the values exist.
If they do exists, add  T[z][i] to a third table that contains the correct master

I don't need code just the logic(if this is possible). If it helps you(as it often helps me understand) here is some python code with my approach/examples:

#data = [-2,10,5,50,20,25,40]
#target_sum = 100
data = [1,2,3,4,5,6,7,8,9,10]
target_sum = 10

# T[x, i] is True if 'x' can be solved
# by a linear combination of data[:i+1]
T = []           # all values are False by default
T.append([0, 0])                # base case

R=200 # Maximum size of any partial sum
max_percent=0.3 # Maximum weight of any term

for i, x in enumerate(data):    # i is index, x is data[i]
    for s in range(-R,R+1): #set the range of one higher than sum to include sum itself
        max_value = int(abs((target_sum * max_percent)/x))
        for c in range(max_value + 1):  
            if [s - c * x, i] in T:
                T.append([s, i+1])

coeff = [0]*len(data)
def RecursivelyListAllThatWork(k, sum): # Using last k variables, make sum
    # /* Base case: If we've assigned all the variables correctly, list this
    # * solution.
    # */
    if k == 0:
        # print what we have so far
        print(' + '.join("%2s*%s" % t for t in zip(coeff, data)))
    x_k = data[k-1]
    # /* Recursive step: Try all coefficients, but only if they work. */
    max_value = int(abs((target_sum * max_percent)/x_k))
    for c in range(max_value + 1):
       if [sum - c * x_k, k - 1] in T:
           # mark the coefficient of x_k to be c
           coeff[k-1] = c
           RecursivelyListAllThatWork(k - 1, sum - c * x_k)
           # unmark the coefficient of x_k
           coeff[k-1] = 0

RecursivelyListAllThatWork(len(data), target_sum)

Any help or suggestions would be appreciated. I have worked on this for a long time and all my experiments have failed. I'm hoping to get the correct answer but even ideas of different approaches would be great so I can experiment with them.

Thank you.

p.s. I have asked a question on stackoverflow 2 days ago about improving my existing algo, but I got answers from posters who admitted to not fully understanding what I was asking for and because they have answered the question, I am unable to delete it to post here. I have flagged it for deletion.

Update: Regarding some of the comments,I'm not looking for a fast way of doing this(although it would be nice), I'm looking for a scalable way..my method works but each loop is dependent on the last loop which causes it to be bound to a single process. The math is in such a way that it builds upon previous results. If I can somehow break the process up into independent parts then I can use more cpu/computers to handle the work. I know it'll take a long time, but if it takes 600 hours on one cpu, then two should cut it down a bit and so on..right now I can't use other computers so I'm forced to wait 600 hours(while everything else on the system is ideal). please help!

Also the results are large but not infinite as I have bounds set so the number cannot exceed a certain percent of target_sum.

  • 1
    $\begingroup$ It's a bit like the knapsack problem, except you don't want to minimize the number of items used. $\endgroup$ – Emre Mar 8 '12 at 7:38
  • 1
    $\begingroup$ If you have a pair of comprime numbers, one positive and one negative in your data set (like the $-2$ and $5$ in your code) then there are an infinite number of solutions for any target (as for any solution there is another with five more $-2$s and two more $5$s). $\endgroup$ – Henry Mar 8 '12 at 8:04
  • $\begingroup$ I don't see it as a knapsack problem, rather looking for all partitions of a given $n$ into parts from a given set. I think you're going to run into some very large numbers, even for not-so-large problems. I bet the number of ways of getting sum 100 using just numbers from 1 to 10 is in the millions. $\endgroup$ – Gerry Myerson Mar 8 '12 at 11:12
  • $\begingroup$ @GerryMyerson: There are $6292069$ such ways. $\endgroup$ – Marc van Leeuwen Mar 8 '12 at 13:20
  • $\begingroup$ Re:some of the comments so far. Henry I have bounds so in the code above(to test) max_percent variable limits a single number from exceeding a percent of the total so numbers cannot grow to infinity. @GerryMyerson I understand the numbers will be large but I have logic to study/eliminate certain results but I simply need them first to evaluate. Marc Van Leeuwen is totally correct at the number of results, it only took 0.164 seconds to generate all the results on my old laptop. $\endgroup$ – Error_404 Mar 8 '12 at 13:43

This is not an answer, since (as indicated in the comments) there is not going to be a fast way to write down the set you are looking at just because it can be so huge! There are reasonable algorithms for computing exactly how huge; here is one simple idea (it is not the most efficient way known to humans).

We want to compute the number of ways to write $n$ as a non-negative integer linear combination of a given set $A=\{a_1,a_2,\dots,a_k\}$ of positive integers (that is, for the number of integer partitions of $n$ with parts in $A$). Here is one strategy: let $p_A(n)$ denote the number of integer partitions of $n$ with parts in $A$. Let $$f_A(x)=\sum_{n=0}^\infty p_A(n) x^n=\prod_{i=1}^k \frac{1}{1-x^{a_i}}$$ be the "generating function" for the sequence $p_A(n)$. The product expansion (which I am not proving here) shows that it is a rational generating function, and this means that the sequence $p_A(n)$ satisfies a finite linear recurrence, which you can use to compute the exact value or (much more quickly) an asymptotic formula. Rational generating functions are the subject of Chapter 4 of Stanley's famous book "Enumerative combinatorics" (vol. 1), where you might look for more information. For instance, the form of the generating function above implies that the sequence $p_A(n)$ is a "quasi-polynomial" (section 4.4 of Stanley).

  • $\begingroup$ Thank you very much Steve. I'm very new to all this but I'll try to find Stanley's book and try to understand this. Is it possible to write the logic of what your doing out so I can understand it better..the formula, I'm sure is interesting but I am not sure how to understand some of the symbols. $\endgroup$ – Error_404 Mar 8 '12 at 15:29

I assume that you are trying to generate partitions rather than the simpler task of counting how many there are.

What you need to do is generate smaller partitions with part of the data and then add the next piece of data up to the target. There is a cost here as you are also building all partitions from the data that add up to less than the target.

The following is in R code, and not very efficient at that, but should be reasonably clear for translation into other languages. It will not work for negative or zero data; it will work for the data in any order.

data              <- c(4,2,1)
target_sum        <- 10
partitions        <- as.data.frame( matrix( rep(0,length(data)+1), nrow=1 ) )
names(partitions) <- c(data,"total")

for (i in 1:length(data) ) {
    for (j in data[i]:target_sum) {
        newpartitions = partitions[partitions$total == j - data[i], ]
        if (nrow(newpartitions) > 0) {
            newpartitions[ ,i]  <- newpartitions[ ,i] + 1   
            newpartitions$total <- j
            partitions          <- rbind(partitions, newpartitions)

result            <- partitions[partitions$total == target_sum, ] 
rownames(result)  <- NULL

This particular version produces

   4 2  1 total
1  2 1  0    10
2  1 3  0    10
3  0 5  0    10
4  2 0  2    10
5  1 2  2    10
6  0 4  2    10
7  1 1  4    10
8  0 3  4    10
9  1 0  6    10
10 0 2  6    10
11 0 1  8    10
12 0 0 10    10
  • $\begingroup$ Wow! Thank you Henry, didn't expect anyone to be able to help(losing hope) but looks interesting. I'm not good at R but your code seems readable, I'll work on breaking it down and trying to understand it. I'll report back, but thank you very much. $\endgroup$ – Error_404 Mar 9 '12 at 2:02

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.