Big Data Processing and Mining for Next Generation Intelligent Transportation Systems

Authors

  • Jelena Fiosina Clausthal University of Technology, Institute of Informatics, Julius-Albert Str. 4, D-38678, Clausthal-Zellerfeld, Germany
  • Maxims Fiosins, Jörg P. Müller Clausthal University of Technology, Institute of Informatics, Julius-Albert Str. 4, D-38678, Clausthal-Zellerfeld, Germany

DOI:

https://doi.org/10.11113/jt.v63.1949

Keywords:

Cloud computing architecture, ambient intelligence, big data processing and mining, multi-agent systems, distributed decision-making

Abstract

The deployment of future Internet and communication technologies (ICT) provide intelligent transportation systems (ITS) with huge volumes of real-time data (Big Data) that need to be managed, communicated, interpreted, aggregated and analysed. These technologies considerably enhance the effectiveness and user friendliness of ITS, providing considerable economic and social impact. Real-world application scenarios are needed to derive requirements for software architecture and novel features of ITS in the context of the Internet of Things (IoT) and cloud technologies. In this study, we contend that future service- and cloud-based ITS can largely benefit from sophisticated data processing capabilities. Therefore, new Big Data processing and mining (BDPM) as well as optimization techniques need to be developed and applied to support decision-making capabilities. This study presents real-world scenarios of ITS applications, and demonstrates the need for next-generation Big Data analysis and optimization strategies. Decentralised cooperative BDPM methods are reviewed and their effectiveness is evaluated using real-world data models of the city of Hannover, Germany. We point out and discuss future work directions and opportunities in the area of the development of BDPM methods in ITS.

References

NESSI – Big Data White Paper. December 2012. Big Data - A New World of Opportunities. European Commision.

McKinsey Global Institute. June 2011. Big Data: The next frontier for innovation, competition and productivity. URL: www.mckinsey.com/.

7-th European Framework Programme project, Instant Mobility. Multimodality for people and goods in urban area. CP 284806. http://instant-mobility.com/.

Gartner. 2013. Gartner Reveals Top Predictions for IT Organisations and Users for 2013 and Beyond. http://www.gartner.com/it/page.jsp?id=2211115.

Talia, D. 2011. Cloud computing and software agents: Towards cloud intelligent services. Proc. of the 12th Workshop on Objects and Agents. 741: 2–6.

Müller, J. P. 1996. The Design of Intelligent Agents. Lecture Notes in Artificial Intelligence. 1177.

Fischer, K., N. Kuhn, and J. Müller. 1994. Distributed, Knowledge-Based, Reactive Scheduling in the Transportation Domain. Proceedings of the Tenth IEEE Conference on Artificial Intelligence for Applications. San Antonio, Texas. 47–53.

Fiosina, J., and M. Fiosins. 2013. Chapter 1: Cooperative Regression-Based Forecasting in Distributed Traffic Networks. In: Memon, Q. A. edited Distributed Network Intelligence, Security and Applications. CRC Press, Taylor and Francis Group. 3–37.

Fiosins, M., J. Müller, and M. Huhn. 2013. A Norm-Based Probabilistic Decision-Making Model for Autonomic Traffic Networks. Highlights on Practical Applications of Agents and Multi-Agent Systems. Communications in Computer and Information Science. 365: 49–60.

Foster, I. 2008. Cloud computing and grid computing 360-degree compared. Proc. of the Grid Computing Environments Workshop.

Xiao, L., and Z. Wang. 2011. Internet of Things: a New Application for Intelligent Traffic Monitoring System. Journal of Networks. 6(6):887-894.

Wang, J., J. Cho, S. Lee, and T. Ma. 2011. Real Time Services for Future Cloud Computing Enabled Vehicle Networks. Proc. of the 13th Int. IEEE Annual Conf. on ITS. 1–5.

Li, Z., C. Chen, and K. Wang. 2011. Cloud Computing for Agent-based Urban Transportation Systems. IEEE Intelligent Systems. 26(1):73–79.

Wang, F. 2011. Toward a Revolution in Transportation Operations: AI for Complex Systems. IEEE Intelligent Systems. 23(6): 8–13.

Fiosins, M., J. Fiosina, and J. Müller. 2012. Change Point Analysis for Intelligent Agents in City Traffic. Agents and Data Mining Interaction. LNCS. 7103: 195–210.

Fiosins, M., J. Fiosina, J. P. Müller, and J. Görmer. 2011. Reconciling Strategic and Tactical Decision Making in Agent-Oriented Simulation of Vehicles in Urban Traffic. Proc. of 4th Int. ICST Conf. on Simulation Tools and Techniques (SimuTools'2011). 144–151.

Fiosina, J., M. Fiosins, and J. Müller. 2013. Mining the Traffic Cloud: Data Analysis and Optimization Strategies for Cloud-based Cooperative Mobility Management. Proc. of Int. Sym. on Management Int. Systems. Adv. in Int. Syst. and Comp. 220: 25–32.

Fiosina, J., and M. Fiosins. 2012. Cooperative kernel-based forecasting in decentralized multiagent systems for urban traffic networks. Proc. of Ubiquitous Data Mining (UDM) Workshop of ECAI. Montpellier, France. CEUR-WS.org. 960: 3–7.

Fiosina, J. 2012. Decentralised Regression Model for Intelligent Forecasting in Multi-agent Traffic Networks. Proc. of the 9th Int. Conf. on Distributed Computing and Artificial Intelligence. S. Omatu et al. (Eds.). Advances in Intelligent and Soft Computing. 151: 255–263.

Fiosins, M., J. Fiosina, J. Müller, and J. Görmer. 2011. Agent-based Integrated Decision Making for Autonomous Vehicles in Urban Traffic. Adv. in Int. and Soft Comp. 88: 173–178.

Draper, N., and H. Smith. 1998. Applied Regression Analysis. Willey.

Box, G., G. Jenkins, and G. Reinsel. 2008. Time Series Analysis: Forecasting and Control. Wiley.

Duran, B., and P. Odell. 1974. Cluster Analysis: A Survey. London: Springer.

Michie, D., D. Spiegelhalter, and C. Taylor. 2009. Machine Learning: Neural and Statistical Classification. Overseas Press.

Chen, J., and A. Gupta. 2011. Parametric Statistical Change Point Analysis: With Applications to Genetics, Medicine, and Finance. Birkhäuser.

Freitas, 2002. A. Data Mining and Knowledge Discovery with Evolutionary Algorithms. Springer.

A. L. Symeonidis, and P. A. Mitkas. 2005. Agent Intelligence Through Data Mining. Multiagent Systems, Artificial Societies, and Simulated Organizations. New York: Springer-Verlag.

da Silva, J., C. Giannella, R. Bhargava, H. Kargupta, and M. Klusch. 2005. Distributed Data Mining and Agents. Eng. Appl. of AI. 18(7): 791–807.

Cao, L., D. Luo, and C. Zhang. 2009. Ubiquitous Intelligence in Agent Mining. Agents and Data Mining Interaction (Lecture Notes in Computer Science). 5680: 23–35.

Klusch, M., S. Lodi, and G. Moro. 2003. Agent-based Distributed Data Mining: The KDEC scheme. AgentLink. 104–122.

Zhang, C., Z. Zhang, and L. Cao. 2005. Agents and Data Mining: Mutual Enhancement by Integration. AIS-ADM2005. LNCS. 3505: 50–61.

Othmane, B., R. Hebri, and M. Boudiaf. 2012. Cloud Computing and Multi-Agent Systems: A new Promising Approach for Distributed Data Mining. Proc. of the 34th Int. Conf. on Information Technology Interfaces.

Gentle, J. E. 2009. Computational Statistics. Springer.

Wu, C. 1986. Jackknife, Bootstrap and Other Resampling Methods in Regression Analysis. The Annals of Statistics. 14(3): 1261–1295.

Afanasyeva, H. 2005. Resampling Median Estimators for Linear Regression Model. Transport and Telecommunication. 6(1): 90–94.

Afanasyeva, H., and A. Andronov. 2006. On Robustness of Resampling Estimators for Linear Regression Models. Communications in Dependability and Quality Management: An international Journal. 9(1): 5–11.

Afanasyeva, H. 2001. Genetics-based Machine Learning Systems for Classification Task. Scientific Proc. of Riga Technical University. 8–16.

Afanasyeva, H. 2002. Fuzzy Learning Classifiers Systems for Classification Task. Transport and Telecommunication. 3(3): 43–51.

Afanasyeva, H. 2005. Resampling-approach to a Task of Comparison of Two Renewal Processes. Proc. of 12th Int. Conf. on Analytical and Stochastic Modelling Techniques and Applications, Riga. 13–21.

Andronov, A., and M. Fiosins. 2004. Applications of Resampling Approach to Statistical Problems of Logical Systems. Acta et Commentationes Universitatis Tartuensis de Mathematica. 8: 63–72.

Fiosins, M. 2000. Efficiency Of Resampling Estimators Of Sequential-Parallel Systems Reliability. Proc. of the 2nd Int. Conf. on Simulation, Gaming, Training and Business Process Reengineering in Operations. Riga. 112–117.

Bazzan, A., and F. Klügl. 2013. A Review on Agent-based Technology for Traffic and Transportation. The Knowledge Engineering Review FirstView. 1–29.

Lin, H., R. Zito, and M. Taylor. 2005. A Review o Travel-time Prediction in Transport and Logistics. Proc. of the Eastern Asia Society for Transportation Studies. 5: 1433–1448.

Malnati, G., C. Barberis, and C. Cuva. 2007. Gossip: Estimating Actual Travelling Time Using Vehicle to Vehicle Communication. 4-th Int. Workshop on Intel. Transportation. Hamburg.

Görmer, J., Ehmke, J., M. Fiosins,. D. Schmidt, H. Schumacher, and Tchouankem, H. 2011. Decision Support for Dynamic City Traffic Management Using Vehicular Communication. Proc. of 1st Int. Conf. on Simulation and Modeling Methodologies, Technologies and Applications (SIMULTECH 2011). 327–332.

Claes, R., and T. Holvoet. 2011. Ad Hoc Link Traversal Time Prediction. Proc. of the 14th Int. IEEE Conf. on Intelligent Transportation Systems. 1803–1808.

Guestrin, C., P. Bodik, R. Thibaux, M. Paskin, and S. Madden. 2004. Distributed regression: an efficient framework for modeling sensor network data. Proc. of the 3rd Int. Sym. on Information processing in sensor networks. New York, USA. 1–10.

Stankovic, S., M. Stankovic, and D. Stipanovic. 2009. Decentralized parameter estimation by consensus based stochastic approximation. IEEE Trans. Automatic Control. 56(3): 531–543.

Smith, B., B. Williams, and R. Oswaldl. 2002. Comparison of Parametric and Nonparametric Models for Traffic Flow Forecasting. Transportation Research Part C: Emerging Technologies. 10: 303–321.

Weijermars, W., and E. van Berkum. 2005. Analyzing Highway Flow Patterns Using Cluster Analysis. Proc. of the 8th Int. IEEE Conf. on ITS. Vienna. 831–836.

Lee, J., J. Han, and K. Whang. 2007. Trajectory Clustering: A Partition-and-Group Framework. Proc. of ACM SIGMOD Int. Conf. on Management of Data. Beijing. 593–604.

Hinneburg, A., and H. Gabriel. 2007. DENCLUE 2.0: Fast clustering based on kernel density estimation. Proc. of IDA’07, Adv. in Intelligent Data Analysis VII, LNCS. 4723: 70–80.

Ogston, E., B. Overeinder, M. van Steen, and F. Brazier. 2003. A Method for Decentralized Clustering In Large Multi-agent Systems. Proc. of 2nd Int. Conf. on Autonomous Agents and Multiagent Systems. 789–796.

Fiosina, J., M. Fiosins, and J. Müller. 2013. Decentralised Cooperative Agent-based Clustering in Intelligent Traffic Clouds. Proc. of 11th German Conference on Multiagent System Technologies (MATES 2013), LNCS. (accepted for publication).

Fiosina, J., and M. Fiosins. 2013. Density-Based Clustering in Cloud-Oriented Collaborative Multi-Agent Systems. Proc. of Int. Conf. on Hybrid Artificial Intelligence Systems (HAIS 2013). LNCS. (accepted for publication).

Fiosina, J., and M. Fiosins. 2011. Resampling-based Change Point Estimation. Proc. of the 10th Int. Sym. on Intelligent Data Analysis (IDA'11). LNCS. 7014: 150–161.

Fiosina, J., and M. Fiosins. 2013. Selecting The Shortest Itinerary in a Cloud-based Distributed Mobility Network. Proc. of 10th Int. Conf. on Distributed Computing and AI (DCAI 2013). Adv. in Int. Syst. and Comp. 217: 103–110.

Fiosins, M. 2013. Stochastic Decentralized Routing of Unsplittable Vehicle Flows Using Constraint Optimization. Distributed Computing and Artificial Intelligence. Advances in Intelligent Systems and Computing. 217: 37–44.

Härdle, W., M. Müller, S. Sperlich, and A. Werwatz. 2004. Nonparametric and Semiparametric Models. Berlin/Heidelberg: Springer.

Dempster, A., N. Laird, and D. Rubin. 1977. Maximum Likelihood from Incomplete data via the EM Algorithm. J. of the Royal Stat. Society. Series B. 39: 1–38.

Ben-Hur, A., A. Elisseeff, and I. Guyon. 2002. A Stability Based Method for Discovering Structure in Clustered Data. Pacific Sym. on Biocomputing. 7: 6–17.

Racine, J. S. 1997. Consistent Significance Testing for Nonparametric Regression. Journal of Business and Economic Statistics. 15: 369–379.

Passos, L., R. Rossetti, and E. Oliveira. 2010. Ambient-centred Intelligent Traffic Control and Management. Proc. of the 13th Int. IEEE Annual Conf. on ITS. 224–229.

Kargupta, H., and P. Chan. 2000. Advances in Distributed and Parallel Knowledge Discovery. California, USA:AAAI Press/MIT Press.

Lee, W., S. Tseng, and W. Shieh. 2010. Collaborative Real-time Traffic Information Generation and Sharing Framework for the Intelligent Transportation System. Inf. Sciences. 180: 62–70.

Downloads

Published

2013-07-15

Issue

Section

Science and Engineering

How to Cite

Big Data Processing and Mining for Next Generation Intelligent Transportation Systems. (2013). Jurnal Teknologi, 63(3). https://doi.org/10.11113/jt.v63.1949