Smart finite state devices: A modeling framework for demand response technologies

Konstantin Turitsyn; Scott Backhaus; Maxim Ananyev; Michael Chertkov

doi:10.1109/CDC.2011.6160649

Smart finite state devices: A modeling framework for demand response technologies

Konstantin Turitsyn, Scott Backhaus, Maxim Ananyev, Michael Chertkov

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

24 Scopus citations

Abstract

We introduce and analyze Markov Decision Process (MDP) machines to model individual devices which are expected to participate in future demand-response markets on distribution grids. We differentiate devices into the following four types: (a) optional loads that can be shed, e.g. light dimming; (b) deferrable loads that can be delayed, e.g. dishwashers; (c) controllable loads with inertia, e.g. thermostatically-controlled loads, whose task is to maintain an auxiliary characteristic (temperature) within pre-defined margins; and (d) storage devices that can alternate between charging and generating. Our analysis of the devices seeks to find their optimal price-taking control strategy under a given stochastic model of the distribution market.

Original language	English (US)
Title of host publication	2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	7-14
Number of pages	8
ISBN (Print)	9781612848006
DOIs	https://doi.org/10.1109/CDC.2011.6160649
State	Published - 2011
Externally published	Yes
Event	2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011 - Orlando, FL, United States Duration: Dec 12 2011 → Dec 15 2011

Publication series

Name	Proceedings of the IEEE Conference on Decision and Control
ISSN (Print)	0743-1546
ISSN (Electronic)	2576-2370

Other

Other	2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011
Country/Territory	United States
City	Orlando, FL
Period	12/12/11 → 12/15/11

ASJC Scopus subject areas

Control and Systems Engineering
Modeling and Simulation
Control and Optimization

Access to Document

10.1109/CDC.2011.6160649

Cite this

Turitsyn, K., Backhaus, S., Ananyev, M., & Chertkov, M. (2011). Smart finite state devices: A modeling framework for demand response technologies. In 2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011 (pp. 7-14). Article 6160649 (Proceedings of the IEEE Conference on Decision and Control). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CDC.2011.6160649

Smart finite state devices: A modeling framework for demand response technologies. / Turitsyn, Konstantin; Backhaus, Scott; Ananyev, Maxim et al.
2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011. Institute of Electrical and Electronics Engineers Inc., 2011. p. 7-14 6160649 (Proceedings of the IEEE Conference on Decision and Control).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Turitsyn, K, Backhaus, S, Ananyev, M & Chertkov, M 2011, Smart finite state devices: A modeling framework for demand response technologies. in 2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011., 6160649, Proceedings of the IEEE Conference on Decision and Control, Institute of Electrical and Electronics Engineers Inc., pp. 7-14, 2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011, Orlando, FL, United States, 12/12/11. https://doi.org/10.1109/CDC.2011.6160649

Turitsyn K, Backhaus S, Ananyev M, Chertkov M. Smart finite state devices: A modeling framework for demand response technologies. In 2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011. Institute of Electrical and Electronics Engineers Inc. 2011. p. 7-14. 6160649. (Proceedings of the IEEE Conference on Decision and Control). doi: 10.1109/CDC.2011.6160649

Turitsyn, Konstantin ; Backhaus, Scott ; Ananyev, Maxim et al. / Smart finite state devices : A modeling framework for demand response technologies. 2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011. Institute of Electrical and Electronics Engineers Inc., 2011. pp. 7-14 (Proceedings of the IEEE Conference on Decision and Control).

@inproceedings{0d79c89b05bd4284a374b6c4b3c5a453,

title = "Smart finite state devices: A modeling framework for demand response technologies",

abstract = "We introduce and analyze Markov Decision Process (MDP) machines to model individual devices which are expected to participate in future demand-response markets on distribution grids. We differentiate devices into the following four types: (a) optional loads that can be shed, e.g. light dimming; (b) deferrable loads that can be delayed, e.g. dishwashers; (c) controllable loads with inertia, e.g. thermostatically-controlled loads, whose task is to maintain an auxiliary characteristic (temperature) within pre-defined margins; and (d) storage devices that can alternate between charging and generating. Our analysis of the devices seeks to find their optimal price-taking control strategy under a given stochastic model of the distribution market.",

author = "Konstantin Turitsyn and Scott Backhaus and Maxim Ananyev and Michael Chertkov",

year = "2011",

doi = "10.1109/CDC.2011.6160649",

language = "English (US)",

isbn = "9781612848006",

series = "Proceedings of the IEEE Conference on Decision and Control",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "7--14",

booktitle = "2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011",

note = "2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011 ; Conference date: 12-12-2011 Through 15-12-2011",

}

TY - GEN

T1 - Smart finite state devices

T2 - 2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011

AU - Turitsyn, Konstantin

AU - Backhaus, Scott

AU - Ananyev, Maxim

AU - Chertkov, Michael

PY - 2011

Y1 - 2011

N2 - We introduce and analyze Markov Decision Process (MDP) machines to model individual devices which are expected to participate in future demand-response markets on distribution grids. We differentiate devices into the following four types: (a) optional loads that can be shed, e.g. light dimming; (b) deferrable loads that can be delayed, e.g. dishwashers; (c) controllable loads with inertia, e.g. thermostatically-controlled loads, whose task is to maintain an auxiliary characteristic (temperature) within pre-defined margins; and (d) storage devices that can alternate between charging and generating. Our analysis of the devices seeks to find their optimal price-taking control strategy under a given stochastic model of the distribution market.

AB - We introduce and analyze Markov Decision Process (MDP) machines to model individual devices which are expected to participate in future demand-response markets on distribution grids. We differentiate devices into the following four types: (a) optional loads that can be shed, e.g. light dimming; (b) deferrable loads that can be delayed, e.g. dishwashers; (c) controllable loads with inertia, e.g. thermostatically-controlled loads, whose task is to maintain an auxiliary characteristic (temperature) within pre-defined margins; and (d) storage devices that can alternate between charging and generating. Our analysis of the devices seeks to find their optimal price-taking control strategy under a given stochastic model of the distribution market.

UR - http://www.scopus.com/inward/record.url?scp=84860702053&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860702053&partnerID=8YFLogxK

U2 - 10.1109/CDC.2011.6160649

DO - 10.1109/CDC.2011.6160649

M3 - Conference contribution

AN - SCOPUS:84860702053

SN - 9781612848006

T3 - Proceedings of the IEEE Conference on Decision and Control

SP - 7

EP - 14

BT - 2011 50th IEEE Conference on Decision and Control and European Control Conference, CDC-ECC 2011

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 12 December 2011 through 15 December 2011

ER -

Smart finite state devices: A modeling framework for demand response technologies

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this