Modeling Distributed Agile Software Development for Big Data Projects: Evolution in Process
Current Journal of Applied Science and Technology,
Although big data has been around for ages, finding the right development method for the specific domain of big data has always been challenging. Many companies are taking maximum benefits from the large amount of data that is available to them. However, in order to make use of this large amount of data, developing and maintaining a dependable and robust software system is a major problem today. We proposed an enriched nonlinear distributed agile development model in big data applications. The model makes it possible to overcome the difficulties of traditional software process models by pairing up evolving technology of big data and distributed agile methodology. In the paper we, first, present arguments behind the multi-agent model. Next, it is shown how it may help improve the interaction between big data and software development project life cycle. Finally, we suggest how the proposed model can be tested experimentally to show how devising a multi-agent computational system may offer an efficient way of monitoring, managing, and deploying software products in big data applications.
- Big data analytics
- distributed agile software development
- agile methodologies
- collaborative cloud computing
- multi-agent systems.
How to Cite
ISO/IEC15288:2008—Systems and Software Engineering—System Life Cycle Processes, standard 15288:2008, ISO/IEC; 2008;
Lin, Yen-Tai, Huang, Sun-Jen. Design of a Software Engineering Lifecycle Process for Big Data Projects, in IT Professional. 2018;20(1):45-52.
Henrion, Max. Why Bid Data Analytics Projects Fail”, in Analytics Project; 2019.
Andrew White. Our top data and analytics predictions for January; 2019.
Li N, Escalona A, Guo Y, Offutt J. A scalable big data test framework, in Software Testing, Verification and Validation, Intl. Conf. on. IEEE; 2015.
Xu, Xiaofei, Motta Gianmario, Tu, Zhiying, Xu Hanchuan, Wang Zhongjie, Wang Xianzhi. A new paradigm of software service engineering in big data and big service era. Computing. Archives for Informatics and Numerical Computation. 2018;100(4):353-368.
Benjelloun FZ, Lahcen AA, Belfkih S. An overview of big data opportunities, applications and tools, in Intelligent Systems and Computer Vision; 2015.
Sever A. Modelling distributed agile software development utilizing cloud computing. Journal of Applied Science and Technology; 2019.
Madhavji NH, Miranskyy A, Kontogiannis K. Big picture of big data software engineering: With example research challenges, in Proceedings of the Intl. Workshop on BIG Data Software Engineering. IEEE Press; 2015.
Belo O, Cuzzocrea A, Oliveira B. Modeling and supporting ETL processes via a pattern-oriented, task-reusable framework, in Tools with Artificial Intelligence, Intl. Conf. on. IEEE; 2014.
Douglas CC. An open framework for dynamic bigdata-driven Application Systems (DBDDAS) development, Procedia Computer Science; 2014.
Bazargani S, Brinkley J, Tabrizi N. Implementing conceptual search capability in a cloud-based feed aggregator, in Innovative Computing Technology, Intl. Conf. on. IEEE; 2013.
Pääkkönen, Pakkala. Reference architecture and classification of technologies, product, and services for big data systems. 2015;2(4):166–168.
Esposito, Ficco, Palmieri, Castiglione. A knowledge-based platform for Big Data analytics based on publish/subscribe services and stream processing. Knowledge-Based Systems. 2015;79:3-17.
Xinhua E, Han J, Wang Y, Liu L. Big Data-as-a Service: Definition and architecture,” in Communication Technology, IEEE Intl. Conf. on; 2013.
Shelton T, Poorthuis A, Graham M, Zook M. Mapping the data shadows of Hurricane Sandy: Uncovering the sociospatial dimensions of big data, Geoforum; 2014.
Demchenko Y, Turkmen F, de Laat C, Blanchet C, Loomis C. Cloud based big data infrastructure: Architectural components and automated provisioning. International Conference on High Performance Computing & Simulation (HPCS), Innsbruck. 2016;628-636.
Vijay Dipti Kumar, Paulo Alencar. Software engineering for big data projects: Domains, Methodologies and gaps. IEEE International Conference on Big Data (Big Data); 2016.
O’Sullivan P, Thompson G, Clifford A. Applying data models to big data architectures. IBM Journal of Research and Development; 2014.
Chen HM, Kazman R, Haziyev S. Strategic prototyping for developing big data systems. IEEE Software; 2016.
Cecchinel C, Jimenez M, Mosser S, Riveill M. An architecture to support the collection of big data in the Internet of Things, in Services, World Congress on. IEEE; 2014.
Krämer, Senner. A modular software architecture for processing of big geospatial data in the cloud. Computers & Graphics. 2015;49(C):69-81.
Al Zamil MG, Samarah S. The application of semantic-based classification on big data, in Information and Communication Systems, Intl. Conf. on. IEEE; 2014.
Agrawal R, Imran A, Seay C, Walker J. A layer-based architecture for provenance in big data, in Big Data, IEEE Intl. Conf. on; 2012.
Yang-Turner F, Lau L, Dimitrova V. A model-driven prototype evaluation to elicit requirements for a sense making support tool, in Software Engineering Conf., Asia-Pacific. IEEE; 2012.
Breuker D. Towards model-driven engineering for big data analytics–An exploratory analysis of domain-specific languages for machine learning, in System Sciences, Hawaii Intl. Conf. on. IEEE; 2014.
Vanauer M, Bohle C, Hellingrath B. Guiding the introduction of big data in organizations: A methodology with business-and data-driven ideation and enterprise architecture management-based implementation, in System Sciences, Hawaii Intl. Conf. on. IEEE; 2015.
Waltz D, Kasif S. On Reasoning from Data, ACM Computing Survey. 1995;27(3):356-359.
Rahman F, Slepian M, Mitra A. A novel big-data processing framework for healthcare applications: Big-data-healthcare-in-a-box. IEEE International Conference on Big Data (Big Data), Washington, DC. 2016;3548-3555.
Dresner Advisory Services, Big Data Analytics Market Study; 2017.
Abstract View: 387 times
PDF Download: 270 times