Shaolei Ren

Provably-Efficient Job Scheduling for Energy and Fairness in Geographically Distributed Data Centers

Decreasing the soaring energy cost is imperative in large data centers. Meanwhile, limited computational resources need to be fairly allocated among different organizations. Latency is another major concern for resource management. Nevertheless, energy cost, resource allocation fairness, and latency are important but often contradicting metrics on scheduling data center workloads. In this paper, we explore the benefit of electricity price variations across time and locations. We study the problem of scheduling batch jobs, which originate from multiple organizations/users and are scheduled to multiple geographically-distributed data centers. We propose a provably-efficient online scheduling algorithm -- Gre Far -- which optimizes the energy cost and fairness among different organizations subject to queueing delay constraints. Gre Far does not require any statistical information of workload arrivals or electricity prices. We prove that it can minimize the cost (in terms of an affine combination of energy cost and weighted fairness) arbitrarily close to that of the optimal offline algorithm with future information. Moreover, by appropriately setting the control parameters, Gre Far achieves a desirable tradeoff among energy cost, fairness and latency.

Pricing and Distributed Power Control in Wireless Relay Networks

In this paper, we consider a wireless amplify-and-forward relay network with one relay node and multiple source-destination pairs/users and propose a pricing framework that enables the relay to set prices to maximize either its revenue or any desirable system utility. Specifically, depending on the quality of the received signals, the relay sets prices and correspondingly charges the users utilizing its resources for their transmissions. The price is determined in such a way that the relays revenue or system utility is maximized. Given the specified price, the users competitively employ the relay node to forward their signals. We model each user as a rational player, which aims at maximizing its own net utility through power allocation, and analyze the competition among the users within the framework of noncooperative game theory. It is shown that, in the game played by the users, there always exists a unique pure Nash equilibrium point that can be achieved through distributed iterations. Next, subject to the availability of complete information about the users at the relay, we propose a low-complexity uniform pricing algorithm and an optimal differentiated pricing algorithm, in which the relay either charges the users at a suboptimal uniform price or charges different users at different prices. We also show that, by applying the differentiated pricing algorithm that enforces the users to transmit at certain power levels, any system utility can be maximized. Extensive simulations are conducted to quantify the performance of the proposed methods.

Distributed power allocation in multi-user multi-channel cellular relay networks

In this paper, we consider the amplify-and-forward relaying transmission in the downlink of a multi-channel cellular network with one base station and multiple relay-destination pairs. Spatial reuse of the relaying slot by allowing simultaneous transmissions from the relays is adopted to avoid the spectral loss incurred by the half-duplex relays. The relays are modeled as rational agents engaging in a non-cooperative game. In order to maximize its individual rate, each relay node iteratively allocates its power across different subchannels based on local information, while treating the signals from the other users as additive noise. First, we propose a distributed algorithm based on best response that is applicable in any signal to interference plus noise ratio (SINR) regions. Then, by focusing on the low SINR region, we propose a modified iterative water-filling algorithm. The existence of Nash equilibrium (NE) is guaranteed and the sufficient condition to reach a NE iteratively is determined. Next, we consider medium to high SINR regions and propose a distributed algorithm based on the sub-optimal response, which can be shown to reduce to the classic Gaussian interference channel model, for which analytical sufficient conditions for the convergence to the unique NE can be readily obtained. Finally, we extend the analysis to a general network topology wherein the users having different channel conditions coexist. The results show that, in low SINR regions, the proposed modified iterative water-filling algorithm yields a higher average sum rate than two simplified algorithms, i.e., the equal power allocation scheme and the conventional time-division based protocol, while in medium to high SINR regions, the sub-optimal-response based algorithm outperforms these two simplified algorithms in terms of the average sum rate

Thermal-Aware Scheduling of Batch Jobs in Geographically Distributed Data Centers

Decreasing the soaring energy cost is imperative in large data centers. Meanwhile, limited computational resources need to be fairly allocated among different organizations. Latency is another major concern for resource management. Nevertheless, energy cost, resource allocation fairness, and latency are important but often contradicting metrics on scheduling data center workloads. Moreover, with the ever-increasing power density, data center operation must be judiciously optimized to prevent server overheating. In this paper, we explore the benefit of electricity price variations across time and locations. We study the problem of scheduling batch jobs to multiple geographically-distributed data centers. We propose a provably-efficient online scheduling algorithm - GreFar - which optimizes the energy cost and fairness among different organizations subject to queueing delay constraints, while satisfying the maximum server inlet temperature constraints. GreFar does not require any statistical information of workload arrivals or electricity prices. We prove that it can minimize the cost arbitrarily close to that of the optimal offline algorithm with future information. Moreover, we compare the performance of GreFar with ones of a similar algorithm, referred to as T-unaware, that is not able to consider the server inlet temperature in the scheduling process. We prove that GreFar is able to save up to 16 percent of energy-fairness cost with respect to T-unaware.

Dynamic Scheduling and Pricing in Wireless Cloud Computing

In this paper, we consider a wireless cloud computing system in which the service provider operates a data center and provides cloud services to its subscribers at dynamic prices. We propose a joint optimization of scheduling and pricing decisions for delay-tolerant batch services to maximize the service providers long-term profit. Unlike the existing research on jointly scheduling and pricing that focuses on static or asymptotic analysis, we focus on a dynamic setting and develop a provably-efficient Dynamic Scheduling and Pricing (Dyn-SP) algorithm which, without the necessity of predicting the future information, can be applied to an arbitrarily random environment that may follow an arbitrary trajectory overtime. We prove that, compared to the optimal offline algorithm with future information, Dyn-SP produces a close-to-optimal average profit while bounding the job queue length in the data center. We perform a trace-based simulation study to validate Dyn-SP. In particular, we show both analytically and numerically that a desired tradeoff between the profit and queueing delay can be obtained by appropriately tuning the control parameter. Our results also indicate that, compared to the existing algorithms which neglect demand-side management, cooling system energy consumption, and/or the queue length information, Dyn-SP achieves a higher average profit while incurring (almost) the same average queueing delay.

Efficient Resource Provisioning and Rate Selection for Stream Mining in a Community Cloud

Real-time stream mining such as surveillance and personal health monitoring, which involves sophisticated mathematical operations, is computation-intensive and prohibitive for mobile devices due to the hardware/computation constraints. To satisfy the growing demand for stream mining in mobile networks, we propose to employ a cloud-based stream mining system in which the mobile devices send via wireless links unclassified media streams to the cloud for classification. We aim at minimizing the classification-energy cost, defined as an affine combination of classification cost and energy consumption at the cloud, subject to an average stream mining delay constraint (which is important in real-time applications). To address the challenge of time-varying wireless channel conditions without a priori information about the channel statistics, we develop an online algorithm in which the cloud operator can dynamically adjust its resource provisioning on the fly and the mobile devices can adapt their transmission rates to the instantaneous channel conditions. It is proved that, at the expense of increasing the average stream mining delay, the online algorithm achieves a classification-energy cost that can be pushed arbitrarily close to the minimum cost achieved by the optimal offline algorithm. Extensive simulations are conducted to validate the analysis.

Maximizing the effective capacity for wireless cooperative relay networks with QoS guarantees

In this paper, we propose a resource allocation scheme to increase the effective capacity subject to the queue-overflow statistical Quality-of-Service (QoS) requirement for a multi-relay cooperative wireless network. Firstly, we consider the block fading channels and derive an algorithm in which each relay is allocated a time slot of optimal length during the cooperation phase, based on the channel statistics. Our analysis indicates that when the QoS requirement is loose, only the relay with the best average channel condition should be selected for cooperation. On the other hand, when the QoS requirement becomes more stringent, more relays should participate in cooperation. The asymptotic case when either the transmit power or the number of relays goes to infinity is discussed, and we shall reveal a tradeoff between the transmit power and the number of relays, given a target effective capacity. By modeling the channel correlation by a two-state Markov model, we will develop two sub-optimal time-slot allocation algorithms which can substantially increase the effective capacity compared with the opportunistic and equal allocation schemes. Our results will show that the channel correlation can sharply decrease the effective capacity and that applying the optimal time-slot allocation result obtained in block fading channels directly to correlated fading channels is no longer optimal.

COCA: online distributed resource management for cost minimization and carbon neutrality in data centers

Due to the enormous energy consumption and associated environmental concerns, data centers have been increasingly pressured to reduce long-term net carbon footprint to zero, i.e., carbon neutrality. In this paper, we propose an online algorithm, called COCA (optimizing for COst minimization and CArbon neutrality), for minimizing data center operational cost while satisfying carbon neutrality without long-term future information. Unlike the existing research, COCA enables distributed server-level resource management: each server autonomously adjusts its processing speed and optimally decides the amount of workloads to process. We prove that COCA achieves a close-to-minimum operational cost (incorporating both electricity and delay costs) compared to the optimal algorithm with future information, while bounding the potential violation of carbon neutrality. We also perform trace-based simulation studies to complement the analysis, and the results show that COCA reduces cost by more than 25% (compared to state of the art) while resulting in a smaller carbon footprint.

Online capacity provisioning for carbon-neutral data center with demand-responsive electricity prices

Due to the huge electricity consumption and carbon emissions, data center operators have been increasingly pressured to reduce their net carbon footprints to zero, i.e., carbon neutrality. In this paper, we propose an efficient online algorithm, called CNDC (optimization for Carbon-Neutral Data Center), to control the number of active servers for minimizing the data center operational cost (defined as a weighted sum of electricity cost and delay cost) while satisfying carbon neutrality without requiring long-term future information. Unlike prior research on carbon neutrality, we explore demand-responsive electricity price enabled by the emerging smart grid technology and demonstrate that it can be incorporated in data center operation to reduce the operational cost. Leveraging the Lyapunov optimization technique, we prove that CNDC achieves a close-to-minimum operational cost compared to the optimal algorithm with future information, while bounding the potential violation of carbon neutrality, in an almost arbitrarily random environment. We also perform trace-based simulation as well as experiment studies to complement the analysis. The results show that CNDC reduces the cost by more than 20% (compared to state-of-the-art prediction-based algorithm) while resulting in a smaller carbon footprint. Moreover, by incorporating demand-response electricity prices, CNDC can further decrease the average cost by approximately 2.5%, translating into hundreds of thousands of dollars per year.

Online Learning for Offloading and Autoscaling in Energy Harvesting Mobile Edge Computing

Mobile edge computing (also known as fog computing) has recently emerged to enable in-situ processing of delay-sensitive applications at the edge of mobile networks. Providing grid power supply in support of mobile edge computing, however, is costly and even infeasible (in certain rugged or under-developed areas), thus mandating on-site renewable energy as a major or even sole power supply in increasingly many scenarios. Nonetheless, the high intermittency and unpredictability of renewable energy make it very challenging to deliver a high quality of service to users in energy harvesting mobile edge computing systems. In this paper, we address the challenge of incorporating renewables into mobile edge computing and propose an efficient reinforcement learning-based resource management algorithm, which learns on-the-fly the optimal policy of dynamic workload offloading (to the centralized cloud) and edge server provisioning to minimize the long-term system cost (including both service delay and operational cost). Our online learning algorithm uses a decomposition of the (offline) value iteration and (online) reinforcement learning, thus achieving a significant improvement of learning rate and run-time performance when compared to standard reinforcement learning algorithms such as