Efficient Algorithms for Data Extraction in Big Data

Abiye-Suku; Ominini Monima; E. O. Bennett

Efficient Algorithms for Data Extraction in Big Data

Abiye-Suku, Ominini Monima & E. O. Bennett

Abstract

This paper is centered on the development of an information system for the extraction of e- mails addresses of staff/students in an organization with big data to assist in the dissemination of vital information in a very short time using two algorithms that are rule and machine learning based. The rule-based uses regular expression technique while the machine based is implemented with the decision tree classifier. The proposed tool can be used in the banking sector to extract customers email addresses for posting transaction details and goodwill messages to improve customers’ relationship, in the educational sector the tool can be used to send students’ progress report, registration and payment receipt and lastly in the health sector to send medical reports, globalization and monitoring the hospital quality. The database was generated online since most organizations are very discreet with staff details. Tokenization of the generated data takes place immediately where the domains are determined. The constructive research methodology and object-oriented design technique was used to analyze, design and implement the tool. A customized software application was developed in python programming language for its implementation ensuring the system evaluation met with system requirements and potential users’ expectations. The research extensively carried out testing using different data sizes to execute email addresses extraction and showed the limitations of the tool and potential for further work on the software package.

Keywords

AlgorithmData ExtractionRule BasedMachine Learning

References

Albert, B. (2002). Mining big data in real time. Informatica, 37, 15–20 Alexander T. (2006). Using Regular Expression to Abstract Blood Pressure and Treatment Intensification Information from he Text of Physician Notes". Journal of the American Medical Informatics Association, Pages 691–695,. Baesens, B. (2014). Analytics in a big data world: The Essential Guide to Data Science and its Applications. GOOGLE. pp.15-20. Bernice, P. (2013). The emergence of big data technology and analytics. Journal of Technology Research. Duy D, An B, Qing Zeng-Treitler (2014). Learning regular expression for clinical text classification. Journal of the American Medical Information Association column 21, issue 5 Jonathan, S. W., & Adam, B. (2013). Undefined by data: A survey of big data definitions (Master’s thesis), University of St. Andrews, UK. Khan. N., Habib, S., Gran, B., Soulmaz, S., Mohammed, A. & Aftab, A. A. (2018) The 10 Vs, Issues and Challenges of Big Data. ResearchGata Kitchin, R. (2014). Big Data, new epistemologies and paradigm shifts: SAGE Journal DOI: 10.1177/2053951714528481. pp. 1-12 Kumar, S., Kamesh, K. & Syed U. (2014). A study on Big Data and its Importance, International Journal of Applied Engineering Research ISSN 0973-4562 Volume 9, Number 20. pp. 7469-7479 Utkarsha P. Pisolkar, Shivaji R. Lahane (2015). A memory Efficient Regular Expression Matching by Compressing Deterministic Finite Automata. International journal of computer Application vol 122-no.20 Vikram P. S., Madhusudhana R. E (2013) Big Data - Solutions for RDBMS Problems – A Survey. International Journal of Advanced Research in Computer and Communication Engineering Vol. 2, Issue 9. pp 3686 - 3693

Efficient Algorithms for Data Extraction in Big Data

Abstract

Keywords

References

More Articles from INTERNATIONAL JOURNAL OF APPLIED SCIENCES AND MATHEMATICAL THEORY