Utilize este identificador para referenciar este registo: http://hdl.handle.net/10400.21/5078
Título: Data analytics in the cloud with flexible mapreduced workflows
Autor: Gonçalves, Carlos
Assunção, Luís
Cunha, José C.
Palavras-chave: MapReduce
Workflow
Text mining
Cloud
Data: Dez-2012
Editora: IEEE
Citação: GONÇALVES, Carlos; ASSUNÇÃO, Luís; CUNHA, José C. – Data Analytics in the cloud with flexible mapreduced workflows. In CLOUDCOM'12 Proceedings of the 2012 IEEE 4th International Conference on Cloud Computing Technology and Science. IEEE, 2012. ISBN: 978-1-4673-4511-8. Pp. 427-434
Resumo: Data analytic applications are characterized by large data sets that are subject to a series of processing phases. Some of these phases are executed sequentially but others can be executed concurrently or in parallel on clusters, grids or clouds. The MapReduce programming model has been applied to process large data sets in cluster and cloud environments. For developing an application using MapReduce there is a need to install/configure/access specific frameworks such as Apache Hadoop or Elastic MapReduce in Amazon Cloud. It would be desirable to provide more flexibility in adjusting such configurations according to the application characteristics. Furthermore the composition of the multiple phases of a data analytic application requires the specification of all the phases and their orchestration. The original MapReduce model and environment lacks flexible support for such configuration and composition. Recognizing that scientific workflows have been successfully applied to modeling complex applications, this paper describes our experiments on implementing MapReduce as subworkflows in the AWARD framework (Autonomic Workflow Activities Reconfigurable and Dynamic). A text mining data analytic application is modeled as a complex workflow with multiple phases, where individual workflow nodes support MapReduce computations. As in typical MapReduce environments, the end user only needs to define the application algorithms for input data processing and for the map and reduce functions. In the paper we present experimental results when using the AWARD framework to execute MapReduce workflows deployed over multiple Amazon EC2 (Elastic Compute Cloud) instances.
Peer review: yes
URI: http://hdl.handle.net/10400.21/5078
ISBN: 978-1-4673-4511-8
978-1-4673-4511-8
Aparece nas colecções:ISEL - Eng. Elect. Tel. Comp. - Comunicações



FacebookTwitterDeliciousLinkedInDiggGoogle BookmarksMySpace
Formato BibTex MendeleyEndnote Degois 

Todos os registos no repositório estão protegidos por leis de copyright, com todos os direitos reservados.