Local energy production and distributed energy storage facilities will take a prominent position in the future smart grid along with the challenge of sustainability. To cope with that, smart grid simulation platforms are needed in order to analyze the problems of two-way data and energy flow. The Power Trading Agent Competition (Power TAC) provides an open source, smart grid simulation platform to enable various smart grid studies from the perspective of sustainability. In this paper, we present AgentUDE, which competed in the Power TAC 2014 and 2015 Final games as a broker agent. Here, we create and formalize information system artefacts for the electricity trading problem in a continuous and competitive environment. The main trading problem is partitioned to smaller problems to reduce the complexity. Therefore, wholesale and retail electricity market activities are individually discussed for AgentUDE14. In 2015 competition, we added a capacity control capability to AgentUDE14, which was introduced as AgentUDE15. We show that AgentUDE is a successful broker agent in many metrics, analyzing its performance in controlled experiments and international tournaments. We have also reviewed the tournament data from the winner agent’s point of view.
J.Babic and V.Podobnik, An analysis of power trading agent competition 2014, Agent-Mediated Electronic Commerce187 (2014), 1–15.
2.
F.Bellifemine, A.Poggi and G.Rimassa, JADE–a FIPA-compliant agent framework, in: Proceedings of PAAM, Vol. 99, 1999, 97–108.
3.
E.H.Clarke, Multipart pricing of public goods, Public Choice11(1) (1971), 17–33. doi:10.1007/BF01726210.
4.
C.Derksen, C.Branki and R.Unland, Agent. gui: A multi-agent based simulation framework, in: Computer Science and Information Systems (FedCSIS), 2011 Federated Conference on, IEEE, 2011.
5.
Federal Environmental Agency (FEA), Energieziel 2050: 100% Strom aus erneuerbaren Quellen, available at http://www.umweltbundesamt.de/publikationen/energieziel-2050, accessed on 04.11.2014.
W.Ketter, J.Collins and P.Reddy, Power TAC: A competitive economic simulation of the smart grid, Energy Economics39 (2013), 262–270. doi:10.1016/j.eneco.2013.04.015.
10.
W.Ketter, J.Collins and M.Weerdt, The 2016 power trading agent competition, ERIM report series, 2016.
11.
R.T.Kuate, M.He, M.Chli and H.H.Wang, An intelligent broker agent for energy trading: An MDP approach, in: Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence, 2014, pp. 234–240.
12.
J.J.LaViola, Double exponential smoothing: An alternative to Kalman filter-based predictive tracking, in: Proceedings of the Workshop on Virtual Environments 2003, ACM, May, 2003, pp. 199–206.
13.
B.Liefers, P.L.Han and J.Hoogland, A successful broker agent for power TAC, Agent-Mediated Electronic Commerce187 (2014), 99–113.
14.
T.Logenthiranet al., Multi-Agent System (MAS) for short-term generation scheduling of a microgrid, in: 2010 IEEE International Conference on Sustainable Energy Technologies (ICSET), IEEE, 2010.
15.
T.Logenthiran, D.Srinivasan and A.M.Khambadkone, Multi-agent system for energy resource scheduling of integrated microgrids in a distributed system, Electric Power Systems Research81(1) (2011), 138–148. doi:10.1016/j.epsr.2010.07.019.
16.
T.Logenthiran, D.Srinivasan and D.Wong, Multi-agent coordination for DER in MicroGrid, in: 2008 IEEE International Conference on Sustainable Energy Technologies, IEEE, 2008.
17.
C.Morris and M.Pehnt, Energy Transition: The German Energiewende, Heinrich Böll Stiftung, 2014.
18.
H.S.Nwanaet al., ZEUS: A toolkit and approach for building distributed multi-agent systems, in: Proceedings of the Third Annual Conference on Autonomous Agents, ACM, 1999.
19.
S.Ozdemir and R.Unland, A Winner Agent in a Smart Grid Simulation Platform, 2015 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), Vol. 2, IEEE, 2015.
20.
S.Ozdemir, R.Unland and W.Ketter, Analysis of the Effects of Storage Capabilities Integration on Balancing Mechanisms in Agent-Based Smart Grids, German Conference on Multiagent System Technologies, Springer International Publishing, 2016.
21.
M.Peters, W.Ketter, M.Saar-Tsechansky and J.Collins, A reinforcement learning approach to autonomous decision-making in smart electricity markets, Machine Learning92(1) (2013), 5–39. doi:10.1007/s10994-013-5340-0.
22.
P.P.Reddy and M.M.Veloso, Factored models for multiscale decision-making in smart grid customers, in: AAAI’12 Proceedings of the Twenty-Sixth AAAI Conference on Artificial Intelligence, Toronto, Ontario, July, 2012.
23.
RES, EU, Directive 2009/28/EC of the European Parliament and of the Council of 23 April 2009 on the promotion of the use of energy from renewable sources and amending and sub-sequently repealing Directives 2001/77/EC and 2003/30, Off J. of the EU, European Commission 5 (2009), 16–62.
24.
A.Somani and L.Tesfatsion, An agent based test bed study of wholesale power market performance measures, IEEE Computational Intelligence Magazine3 (2008), 56–72. doi:10.1109/MCI.2008.929843.
25.
R.S.Sutton and A.G.Barto, Reinforcement Learning: An Introduction (Vol. 1, No. 1), MIT Press, Cambridge, 1998.
26.
G.Tesauro and J.L.Bredin, Strategic sequential bidding in auctions using dynamic programming, in: Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems, Part 2, ACM, July, 2002, pp. 591–598.
27.
D.Urieli and P.Stone, TacTex’13: A champion adaptive power trading agent, in: Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence, 2014, pp. 465–471.
28.
L.Vandezande, L.Meeus, R.Belmans, M.Saguan and J.-M.Glachant, Well-functioning balancing markets: A prerequisite for wind power integration, Energy Policy38(7) (2010), 3146–3154. doi:10.1016/j.enpol.2009.07.034.
R.Weron, Electricity price forecasting: A review of the state-of-the-art with a look into the future, International Journal of Forecasting30(4) (2014), 1030–1081. doi:10.1016/j.ijforecast.2014.08.008.
