A Stable Online Algorithm for Energy-Efficient Multiuser Scheduling
DSpace at IIT Bombay
View Archive InfoField | Value | |
Title |
A Stable Online Algorithm for Energy-Efficient Multiuser Scheduling
|
|
Creator |
SALODKAR, N
KARANDIKAR, A BORKAR, VS |
|
Subject |
fading channels
wireless networks communication constraints allocation quality service multiuser fading channel constrained markov decision process energy-efficient scheduling learning algorithm |
|
Description |
In this paper, we consider the problem of energy-efficient uplink scheduling with delay constraint for a multiuser wireless system. We address this problem within the framework of constrained Markov decision processes (CMDPs) wherein one seeks to minimize one cost (average power) subject to a hard constraint on another (average delay). We do not assume the arrival and channel statistics to be known. To handle state-space explosion and informational constraints, we split the problem into individual CMDPs for the users, coupled through their Lagrange multipliers; and a user selection problem at the base station. To address the issue of unknown channel and arrival statistics, we propose a reinforcement learning algorithm. The users use this learning algorithm to determine the rate at which they wish to transmit in a slot and communicate this to the base station. The base station then schedules the user with the highest rate in a slot. We analyze convergence, stability, and optimality properties of the algorithm. We also demonstrate the efficacy of the algorithm through simulations within IEEE 802.16 system.
|
|
Publisher |
IEEE COMPUTER SOC
|
|
Date |
2011-07-31T12:58:13Z
2011-12-26T12:53:01Z 2011-12-27T05:40:06Z 2011-07-31T12:58:13Z 2011-12-26T12:53:01Z 2011-12-27T05:40:06Z 2010 |
|
Type |
Article
|
|
Identifier |
IEEE TRANSACTIONS ON MOBILE COMPUTING, 9(10), 1391-1406
1536-1233 http://dx.doi.org/10.1109/TMC.2010.106 http://dspace.library.iitb.ac.in/xmlui/handle/10054/8128 http://hdl.handle.net/10054/8128 |
|
Language |
en
|
|