Sangho Lee

Sangho Lee

Computer vision engineer

Sampling

less than 1 minute read

Published:

There is a term “Sampling” in statistics. In this page, will see the concept of sampling and how it is adjusted to machine learning.

Description

Sampling means selection of observations to acquire some knowledge of a statistical population. (Wikipedia)

In statistics, when complete enumeration for population is impossible or requires quiet a few resources, than select subset of population to have a knowledge of a population. So it should representative the statistical population well.

Kinds of sampling

  • Ramdom sampling : Literally select samples from population randomly.
  • Ramdom sampling with replacement : It can include same sample for several times
  • Ramdom sampling without replacement : After selection, do not put the sample into the population again. So no chance to select same sample
  • Downsampling : Select less from bigger data set to reduce high-frequency items.
  • Upsampling : Select more from less data set For example, assume there are 6 data as {0,0,0,0,1,1}. When downsampling, takes 2 0s and 2 1s. When upsampling, takes 4 0s and 4 1s.

You May Also Enjoy

XGBoost

2 minute read

Published:

From the latest post about Machine Learning, I dealt with boosting and bagging. Here, in this post, I want to introduce XGBoost, one of boosting algorithms.

Bagging, Boosting

2 minute read

Published:

When study Machine Learning, there are some confusing concept which is not easily understand. In my case, I got confused with the terms Bagging and Boosting. So, let me explain what I studied about Bagging, Boosting and related terms.