Logistic regression: Difference between revisions
From IT위키
No edit summary |
No edit summary |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 3: | Line 3: | ||
'''Logistic regression is a statistical and machine learning technique widely used to solve binary classification problems.''' This algorithm predicts the probability that the outcome variable (dependent variable) belongs to a specific class through a linear combination of independent variables. Although it is primarily applied in binary classification with labels of 0 or 1, it can be extended to multiclass classification as well. | '''Logistic regression is a statistical and machine learning technique widely used to solve binary classification problems.''' This algorithm predicts the probability that the outcome variable (dependent variable) belongs to a specific class through a linear combination of independent variables. Although it is primarily applied in binary classification with labels of 0 or 1, it can be extended to multiclass classification as well. | ||
* '''Logistic''': Used in scenarios requiring dichotomous outcomes, such as pass/fail, success/failure, survival/death, or true/false. | * '''Logistic''': Used in scenarios requiring dichotomous outcomes, | ||
* '''Regression analysis''': Predicts future outcomes based on past trends. Since logistic regression analysis has a categorical dependent variable, it is closer to a classification model. | ** such as pass/fail, success/failure, survival/death, or true/false. | ||
* '''Regression analysis''': Predicts future outcomes based on past trends. | |||
** Since logistic regression analysis has a categorical dependent variable, it is closer to a classification model. | |||
==Functions Used== | ==Functions Used== | ||
| Line 11: | Line 13: | ||
!Function!!Formula | !Function!!Formula | ||
|- | |- | ||
|Sigmoid | |'''Sigmoid''' | ||
1/(1+e<big><sup>-x</sup></big>) | 1/(1+e<big><sup>-x</sup></big>) | ||
||[[ | ||[[File:Sigmoid.png|400x400px]] | ||
|- | |- | ||
| | |'''Hyperbolic Tangent''' | ||
tanh(x) | tanh(x) | ||
||[[ | ||[[File:Tanh.png|400x400px]] | ||
|} | |} | ||
==Types of Regression Analysis== | ==Types of Regression Analysis== | ||
Latest revision as of 12:48, 31 October 2024
Logistic regression is a statistical and machine learning technique widely used to solve binary classification problems. This algorithm predicts the probability that the outcome variable (dependent variable) belongs to a specific class through a linear combination of independent variables. Although it is primarily applied in binary classification with labels of 0 or 1, it can be extended to multiclass classification as well.
- Logistic: Used in scenarios requiring dichotomous outcomes,
- such as pass/fail, success/failure, survival/death, or true/false.
- Regression analysis: Predicts future outcomes based on past trends.
- Since logistic regression analysis has a categorical dependent variable, it is closer to a classification model.
Functions Used[edit | edit source]
| Function | Formula |
|---|---|
| Sigmoid
1/(1+e-x) |
|
| Hyperbolic Tangent
tanh(x) |
|
Types of Regression Analysis[edit | edit source]
- Simple Regression Analysis: Single independent variable
- Multiple Regression Analysis: Two or more independent variables
Advantages and Disadvantages[edit | edit source]
- Advantages: Simple to implement and easy to interpret.
- It has a relatively low risk of overfitting and is effective for binary classification.
- Disadvantages: Performs poorly with data that lacks a linear relationship.
- It is challenging to apply directly to multiclass problems, where techniques like softmax regression are often required.
