Data Mining and Neural Networks
Module code: MA7022
This module will provide a comprehensive grounding in the structure of the data mining process and explain the basic notations and operations. During this module you will familiarise yourself with types of data mining problems and select the necessary approach to its solutions, from evaluation and cleaning of the dataset to selection of the algorithms for data analysis. This module will also cover the basic methods and algorithms for data analysis, and how to construct basic neural networks for data analysis.
Topics covered
- Classification (knn and Decision tree algorithms)
- Entropy and conditional entropy
- Information gain, clustering (k-means, hierarchical clustering and density based algorithms)
- Multivariate regression (linear regression and the kernel trick)
- Probability distribution estimation (Bayes rule and Bayes networks – structure and algorithm of construction)
- Preprocessing
- Data cleaning
- Dimension reduction (principal component analysis)
- Time series, stationary time series (in strong and in weak sense), white noise, random walk, moving average processes
- Autoregressive processes
- Integrated and ARIMA processes
- Smoothing -mean filter and median filter
- Trend analysis and segmentation
- Formal neurons
- Perceptron learning rule and Widrow-Hoff learning rule
- Main types of neural networks (Hopfield, Kohonen and back- propagation of errors) and problems they can solve
- Cascade-correlation algorithms