Data Mining Method Of Extracting The Data From Large Database

Today with the ever growing use of computers in the world, information is constantly moving from one place to another. What is this information, who is it about, and who is using it will be discussed in the following paper. The collecting, interpreting, and determination of use of this information has come to be known as data mining. This term known as data mining has been around only for a short time but the actual collection of data has been happening for centuries. The following paragraph will give a brief description of this history of data collection.

Companies and organizations all over the world are blasting on the scene with data mining and data warehousing trying to keep an extreme competitive leg up on the competition. Always trying to improve the competiveness and the improvement of the business process is a key factor in expanding and strategically maintaining a higher standard for the most cost effective means in any business in today’s market. Every day these facilities store large amounts of data to improve increased revenue, reduction of cost, customer behavior patterns, and the predictions of possible future trends; say for seasonal reasons. Data

Data mining is defined as the process of exploration and analysis of large data sets, and discovering meaningful patterns and rules. The main objective of data mining is to design and work efficiently with large data sets. Data mining helps resolving problems that are time consuming when traditional techniques are used. Data mining techniques are used to predict future trends and to make wise decisions. There are multiple Data Mining techniques available to the Data diggers to make their life easy. In my study report I will be discussing about the different mining techniques, advantages and disadvantages and also about a use case of the data mining techniques on shark attack dataset to predict the attack of sharks based on various attributes.

Data Mining is defined as extracting information from huge sets of data. In other words, we can say that data mining is the procedure of mining knowledge from data. There is a huge amount of data available in the Information Industry. This data is of no use until it is converted into useful information. It is necessary to analyse this huge amount of data and extract useful information from it. Extraction of information is not the only process we need to perform; data mining also involves other processes such as Data Cleaning, Data Integration, Data Transformation, Data Mining, Pattern Evaluation and Data Presentation [12].

A data stream is a real time, continuous, structured sequence of data items. Mining data stream is the process of extracting knowledge from continuous, rapid data records. Data arrives faster, so it is a very difficult task to mine that data. Stream mining algorithms typically need to be designed so that the algorithm works with one pass of the data. Data streams are a computational challenge to data mining problems because of the additional algorithmic constraints created by the large volume of data. In addition, the problem of temporal locality leads to a number of unique mining challenges in the data stream case. The data mining techniques namely clustering, classification and frequent pattern mining are applied to extract the knowledge

Based on these trends, large amount of data are being gathered and stored in databases, and data warehouses. The huge volume and fast pace made the power of data much stronger than what we expected, with lots of potential waiting us to maintain, explore and make decisions about. Using the efficient way to analyze the most helpful and valuable data, as well as to find out the hidden data is becoming urgent and important. Because of these needs, data mining started to be used as a helpful technology, and plays an important role under today’s studying and working environment.

Background - One of the most promising developments in the field of computing and computer memory over the past few decades has been the ability to bring tremendous complex and large data sets into database management that are both affordable and workable for many organizations. Improvement in computer power has also allowed for the field of artificial intelligence to evolve which also improves the sifting of massive amounts of information for appropriate use in business, military, governmental, and academic venues. Essentially, data mining is taking as much information as possible for a variety of databases, sifting it intelligently and coming up with usable information that will help with data prediction, customer service, what if scenarios, and extrapolating trends for population groups (Ye, 2003; Therling, 2009).

Data mining is the process of extracting knowledge from large data sets. It uses artificial intelligence methods to discover the hidden relationships among the huge amount of data that is collected. It has a great potential to improve applications in many fields like Healthcare systems, Customer relationship management, Financial banking, Research analysis, Bio informatics, Marketing analysis, Education, Manufacturing engineering, Criminology and many more. Criminology is the study of crimes and typically a criminologist’s job include analyzing data to determine why the crime was committed and more importantly to predict and prevent criminal behavior in the future. It became an interesting field to apply data mining techniques because of its large datasets and the complexity of relationships between the data. This paper will discuss some of the tools and techniques used in this field to find out important information that will help and support the police forces and reduce social nuisance.

Clustering or Cluster analysis is defined as the process of organizing objects into groups whose members are similar in some way. Therefore, a cluster is the collection of objects which are similar to each other and are dissimilar to the objects belonging to other clusters. The objects in one cluster are more related and have high similarity when compared to the objects that are in other cluster. So, we can also define clustering as "The process of grouping a set of data objects into clusters or various groups so that the objects within the clusters have high similarity, but very dissimilar to objects that are in other clusters". Based on the attribute values that interpret the objects and distance measures the

Data mining techniques are basically categorised into two major groups as Supervised learning and Unsupervised learning. Clustering is a process of grouping the similar data sets into groups. These groups should have two properties like dissimilarity between the groups and similarity within the group. Clustering is covered in the unsupervised learning category. There are no predefined class label

[1] Jaiwei Han and Micheline Kamber “Data Mining: Concepts and Techniques”,Morgan Kaufmann Publications Second Edition,2006

Our research is to apply DM on a given data set extracted from data held in RMIS at JKUAT. The literature review on the methodology used is presented in this chapter under Section 2.4. Before this we have the definition of terms in DM given in section 2.2 defining data mining, concept of knowledge

Abstract-This paper gives a brief description of the above titled paper. Data clustering is one of the most widely used method for various applications. And parallelizing these time-consuming applications is of quite importance. This paper brings out an additional feature of handling input data of various dimensions and thus accordingly handle it.

This research paper highlight the importance and need of data mining in the age of electronic media where large amount of information and consolidated database is readily available. This seemingly useless information can unearth some mind-blowing statistics and predict the future trends with relative ease through use of data mining techniques which can benefit the businesses, start-ups, country and individual alike. However, since data mining is effective in bringing out patterns, correlation and association through complex algorithms and analysis, it has, over the past few decades proved to be a useful tool in cyber or internet security.

From a practical perspective, Data Mining automates the whole process of categorizing and discovering new understandable relationship by using advanced tools and utilizing some basic understanding of statistics, machine learning and database systems. The useful accurate information we acquire after applying this process is reusable and utilized to take important steps towards increased revenue, reduced costs in retail, financial, communication, and marketing business organization. The wide range of applicability in heterogeneous domains which comprises of large volume of rich data makes Data Mining an important and challenging sector for the Data scientists.