Record Details

An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel

DSpace at IIT Bombay

View Archive Info
 
 
Field Value
 
Title An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel
 
Creator SALODKAR, N
BHORKAR, A
KARANDIKAR, A
BORKAR, VS
 
Subject markov decision-processes
stochastic-approximation
wireless networks
transmission
information
policies
scheme
energy efficient scheduling
stochastic approximation
constrained markov decision processes
 
Description In this paper, we consider the problem of energy efficient scheduling under average delay constraint for a single user fading channel. We propose a new approach for on-line implementation of the optimal packet scheduling algorithm. This approach is based on reformulating the value iteration equation by introducing a virtual state called post-decision state. The resultant value iteration equation becomes amenable to online implementation based on stochastic approximation. This approach has an advantage that an explicit knowledge of the probability distribution of the channel state as well as the arrivals is not required for the implementation. We prove that the on-line algorithm indeed converges to the optimal policy.
 
Publisher IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
 
Date 2011-07-31T20:01:09Z
2011-12-26T12:53:08Z
2011-12-27T05:40:17Z
2011-07-31T20:01:09Z
2011-12-26T12:53:08Z
2011-12-27T05:40:17Z
2008
 
Type Article
 
Identifier IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 26(4), 732-742
0733-8716
http://dx.doi.org/10.1109/JSAC.2008.080514
http://dspace.library.iitb.ac.in/xmlui/handle/10054/8221
http://hdl.handle.net/10054/8221
 
Language en