Feature scaling

-
Feature scaling is a technique, performed in Pre-Processing stage, that is done on the independent variables making the associated values of the particular variable  in a fixed range.


Why we need 'Feature Scaling' ?


Some machine learning models give more emphasis on the data of the independent variables over variables itself. That's why Scaling plays a very crucial role in such cases where we have to scale our data according some techniques(discussed later). By applying Feature Scaling we are actually giving the same priority to all the independent variables present in the dataset.


Machine learning models that are affected by Feature Scaling -


Machine learning models or algorithms, involved in distance measurement, are affected by the feature scaling. some of them are 
  • KNN ( K-Nearest Neighbors ) [Used for Regression/Classification]
  • PCA ( Principal component Analysis ) [used for Dimensionality reduction  ]
  • K-means algorithm [used for Clustering(Hierarchical clustering) ]
Let's have a look to the full list

Machine learning models that are affected by Feature Scaling










Different Techniques used for Feature Scaling -


There are many techniques involved for feature scaling. But two of them are mostly used. They are 
  • Min-Max Scalar
  • Standard Scalar

Min-Max Scalar

  • It is a scaling technique used for Normalizing the data.
  • This Min-Max Scalar are greatly affected by the outliers present in the data.
  • it assumes that data is not distributed as  Gaussian nature.
Min-Max Scalar

Standard Scalar

  • It is a scaling technique used for standardize the data.
  • Standard Scalar are not affected by the outliers present in the data 
  • It assumes that data is normally distributed.
Standard Scalar

Difference between Standardization and Normalization -


Standardization means making the mean of the values 0 and variance of them 1. On the other hand,
Normalization means making the values lie in between 0 and 1.

Difference between Standardization and Normalization -



There are Some other scaling techniques such as

  •  Max Abs Scaler
  • Robust Scaler
  • Quantile Transformer Scaler
  • Power Transformer Scaler
  • Unit Vector Scaler
For more info please go through this


Python practice

  • First importing required library and checking the correlation matrix of the data-frame.
required library importing and data-frame creation and checking correlation matrix
  • Then applying Standard Scalar() function and checking the correlation matrix
correlation coefficient matrix
  • Then applying Min-Max Scalar() function and checking the correlation matrix
correlation coefficient matrix


Note: The scaling technique does not affect the covariance matrix, correlation matrix etc.

Conclusion

Form this post we have learnt about the concepts related to Feature Scaling which is very much a necessary steps while preprocessing the data in  some machine learning model and algorithms.

Comments

Post a Comment

Popular posts from this blog

Introduction to Computer Vision

-
Image
  Do you ever think, how Facebook can automatically tag your friend when you upload an image, how your smart phone can recognize you, using it's very advanced and accurate  Face recognition feature.  Have you ever thought how a picture is processed by computer , how a picture  is stored in computer  etc.   These are very few examples, many more will be discussed as we go on, of Computer Vision. Well, In this post we are going to discuss about Computer Vision. So let's get started. What is C omputer Vision ? Computer Vision is a  interdisciplinary field that helps computer to make high-level understanding from digital images and videos to automate the task that human visuals do. It use some techniques  by which computer can understand many useful information from an image and perform some action based on that information. We see an image and our brain can understand the message, delivered by the image. Machines do exactly the same thing. ...
Read more

Logistic Regression

-
Image
In the previous post we have discussed what is Regression and and what is Linear Regression in depth. In this Post we are going to see about LOGISTIC REGRESSION, a classification technique, used in MACHINE LEARNING. What is Logistic Regression? Logistic Regression is another supervised, statistical, predictive model used for classification mostly in 2 classes. But this technique can be used for multinomial classification i.e. more than 2 classes using some method like ' OVR '( ONE VS REST ), ' multinomial ', 'auto' etc.  Note: method will be selected depending upon the solver by default. For more info click  here. Logistic Regression - A Regression Problem This is a very important concept. Actually Logistic regression is implemented using Linear regression. At the end there is a conversion method(discussed later) to make sure the result i.e. the probability for each class lies between 0 and 1.  (0  <  P(A)  <  1) .   In the above, two pic...
Read more

Distance measurement using opencv

-
Image
In Covid-19 pandemic, we all know about the importance of Social Distancing . Right now, It is the only thing that can help to reduce the number of affected people. So I have decided to make a social distancing checker using python. The main idea is to measure the distance of object in the image and if the distance between two objects are less than some predefined pixel value then 'green' dot at the center of the bounding-box will convert to 'red' dot . The output of the code will like this- social distancing checker Python code for Distance Measurement I am providing the python code to measure the distance of the object in the image or each frame of a video. Later I will discuss some key points related to the code. Key points to be Noted: Everything will be the same like object detection (discussed in Part-I and Part-II ) as I have implemented distance measurement based on object detection. We will filter out only the  'person' object   from the obje...
Read more