I am very beginner in Queueing Theory and I am learning in my own. I am struggling in the following situation.
Suppose in a service center if a job arrives it will immediately being processed if a server in the center is available. It is assumed that the center can place only up to three jobs in a queue to be processed when a server is available. If all the places in the queue are full then any new jobs are lost. Suppose that jobs arrive according to a Poisson process with intensity $\lambda=4$ per hour. Let the processing time of a server is exponentially distributed with parameter $\mu=2$. The cost of the server is $\$2$/hour to run a job when it is processing a job and cost nothing when the server is not processing any job. The cost of being a job in the queue is $\$s$/hour which is waiting to be served and if the job is processing then only the machine cost is charged (i.e., $\$2$/hour).
Consider $X(t)$ be the process denoting the number of jobs either being processed or waiting in the queue.
Now my confusions are:
It is assumed that the center can place only up to three jobs in a queue. Does it mean in total the center can place four jobs where 3 are in queue and one is being processed? Or, does it mean the center can place just three jobs either being processed or in the queue? I mean whether there gonna be 4 states $(0,1,2,3)$ or 5 states $(0,1,2,3,4)$?
How do we draw a diagram for the number of jobs at the center including the transition rates between the states (what are the states here) and what is the transition rate matrix for this model?
How do we fix the stationary distribution of $X$?
What is the long-term average total cost (machine cost + queue cost) for this model?
Thanks a lot!