The sum of all values in a dataset divided by the number of values, representing the arithmetic average. It is sensitive to extreme values, unlike the median.
The mean is commonly understood as the 'average' and is a fundamental measure of central tendency, but its sensitivity to outliers can sometimes make it misleading.
Card 2
Median
Answer
The middle value in a dataset when all values are arranged in ascending or descending order, or the average of the two middle values if the dataset has an even number of entries. It is less affected by extreme values than the mean.
The median provides a robust measure of central tendency, particularly useful in skewed distributions or when outliers are present, as it represents the true 'middle ground'.
Card 3
Interquartile Range (IQR)
Answer
The range of the middle 50% of the data, calculated as the difference between the third quartile (Q3) and the first quartile (Q1). It is a measure of statistical dispersion that is resistant to outliers.
The IQR provides a good sense of data spread for the bulk of the observations without being distorted by extreme values, making it useful for identifying outliers via the 1.5*IQR rule.
Card 4
Skewness
Answer
A measure of the asymmetry of the probability distribution of a real-valued random variable about its mean. A distribution is skewed if it is not symmetric, with a 'tail' extending more to one side than the other.
Positive skewness indicates a longer tail to the right (higher values), while negative skewness indicates a longer tail to the left (lower values), impacting the relationship between mean, median, and mode.
Card 5
Outlier
Answer
A data point that significantly differs from other observations in a dataset. Outliers can be due to variability in the measurement or may indicate experimental errors, and they can disproportionately affect statistical analyses.
Identifying outliers is crucial because they can heavily influence the mean and standard deviation, potentially leading to incorrect conclusions if not properly addressed or understood.
Card 6
Frequency Distribution
Answer
A table or graph that displays the frequencies of various outcomes in a sample. Each entry in the table contains the frequency or count of the occurrences of values within a particular group or interval.
Frequency distributions provide an organized summary of data, making it easier to see patterns, identify common values, and visualize the shape of the data before further analysis.
Card 7
Probability
Answer
A numerical measure of the likelihood that an event will occur, expressed as a number between 0 and 1, where 0 indicates impossibility and 1 indicates certainty. It quantifies uncertainty.
Understanding basic probability is foundational for inferential statistics, as it allows us to quantify the chance of observing certain outcomes under specific conditions.
Card 8
Conditional Probability
Answer
The probability of an event occurring given that another event has already occurred. It is calculated as the probability of both events occurring divided by the probability of the given event.
Conditional probability is key in real-world scenarios, such as diagnosing a disease (probability of disease given a positive test) or predicting outcomes based on prior information.
Card 9
Independent Events
Answer
Two events are independent if the occurrence of one does not affect the probability of the other occurring. Their joint probability is simply the product of their individual probabilities.
A common mistake is assuming independence when events are actually related; for example, consecutive coin flips are independent, but drawing cards without replacement are not.
Card 10
Mutually Exclusive Events
Answer
Two events are mutually exclusive if they cannot both occur at the same time. If one event happens, the other cannot, meaning their intersection has a probability of zero.
Mutually exclusive events cannot be independent, as the occurrence of one definitively impacts the probability of the other (making it zero). Think of a single coin toss resulting in both heads and tails.
Card 11
Random Variable
Answer
A variable whose value is a numerical outcome of a random phenomenon or experiment. It can be discrete (countable outcomes) or continuous (outcomes within a range).
Random variables bridge the gap between random events and numerical data, allowing us to apply mathematical analysis to uncertain situations and model their distributions.
Card 12
Normal Distribution
Answer
A continuous probability distribution that is symmetric around its mean, with data near the mean being more frequent in occurrence than data far from the mean, characterized by its distinctive bell shape. It is defined by its mean and standard deviation.
Many natural phenomena and sampling distributions approximate a normal distribution, making it a cornerstone for statistical inference and hypothesis testing.
Card 13
Central Limit Theorem (CLT)
Answer
States that, given a sufficiently large sample size, the sampling distribution of the sample mean of a population will be approximately normal, regardless of the shape of the original population distribution. This holds true even if the population distribution itself is not normal.
The CLT is critical because it allows us to use normal distribution theory for hypothesis testing and confidence interval construction, even when we don't know the population's exact distribution, provided sample sizes are large enough (typically n > 30).
Card 14
Binomial Distribution
Answer
A discrete probability distribution that models the number of successes in a fixed number of independent Bernoulli trials, where each trial has only two possible outcomes (success or failure) and the probability of success is constant for each trial.
Used for situations with a fixed number of 'yes/no' or 'success/failure' events, such as the number of heads in 10 coin flips or the number of defective items in a batch.
Card 15
Population
Answer
The entire group of individuals, objects, or data points about which information is desired or conclusions are to be drawn. It represents the complete set of observations relevant to a study.
Distinguishing between population and sample is fundamental; a population is the 'who we want to know about,' while a sample is 'who we actually observe.'
Card 16
Sample
Answer
A subset of the population that is selected for observation and analysis. It is used to make inferences about the characteristics of the larger population.
Since it's often impractical or impossible to study an entire population, samples are essential, but their representativeness is key to valid inferences.
Card 17
Simple Random Sample
Answer
A method of sampling where every individual or item in the population has an equal and independent chance of being selected for the sample. This minimizes bias and ensures representativeness.
Ensuring a simple random sample is crucial for statistical inference, as it allows us to generalize findings from the sample back to the population with a known level of confidence.
Card 18
Sampling Error
Answer
The natural discrepancy or difference between a sample statistic (e.g., sample mean) and the corresponding population parameter (e.g., population mean) that occurs simply due to the fact that a sample is not a perfect representation of the population. It is not a mistake but an inherent part of sampling.
Sampling error is unavoidable when working with samples and is quantified by measures like standard error, which is crucial for constructing confidence intervals and performing hypothesis tests.
Card 19
Sampling Distribution
Answer
The probability distribution of a statistic (e.g., sample mean, sample proportion) obtained by drawing all possible samples of a specific size from a population. It shows how much variability to expect in that statistic across different samples.
The sampling distribution is a theoretical concept vital for inferential statistics, as it allows us to understand the behavior of sample statistics and make probability statements about population parameters.
Card 20
Point Estimate
Answer
A single value calculated from a sample that serves as the best single guess or approximation of an unknown population parameter. For example, the sample mean is a point estimate for the population mean.
While simple, a point estimate alone doesn't convey the precision or uncertainty of the estimation; confidence intervals address this limitation by providing a range.
Card 21
Confidence Interval (CI)
Answer
A range of values, derived from sample data, that is likely to contain the true value of an unknown population parameter with a certain level of confidence. It provides both an estimate and a measure of its precision.
A confidence interval is more informative than a point estimate alone, as it communicates the uncertainty associated with the estimate, showing a plausible range for the true population value.
Card 22
Confidence Level
Answer
The probability, expressed as a percentage, that a confidence interval constructed from sample data will contain the true population parameter if the sampling procedure were repeated many times. Common levels are 90%, 95%, and 99%.
A 95% confidence level means that if we were to construct many such intervals, 95% of them would contain the true population parameter, not that there is a 95% chance the true parameter is within a single interval.
Card 23
Margin of Error
Answer
The maximum estimated difference between a sample statistic and the true population parameter, typically used in conjunction with a confidence interval. It represents half the width of the confidence interval.
A smaller margin of error implies a more precise estimate, often achieved with larger sample sizes or lower confidence levels, reflecting the range of uncertainty around a point estimate.
Card 24
Null Hypothesis (H0)
Answer
A statement of no effect, no difference, or no relationship in the population, typically representing the status quo or a statement to be tested and potentially rejected. It is assumed true until evidence suggests otherwise.
In hypothesis testing, we always try to find evidence against the null hypothesis, rather than directly proving the alternative hypothesis.
Card 25
Alternative Hypothesis (Ha)
Answer
A statement that contradicts the null hypothesis, proposing that there is an effect, a difference, or a relationship in the population. It is what the researcher typically aims to support if the null hypothesis is rejected.
The alternative hypothesis is the research hypothesis; it asserts what we believe might be true if the null hypothesis is found to be implausible.
Card 26
P-value
Answer
The probability of observing a test statistic as extreme as, or more extreme than, the one calculated from the sample data, assuming the null hypothesis is true. A small p-value indicates strong evidence against the null hypothesis.
A common misinterpretation is that a p-value is the probability that the null hypothesis is true; instead, it quantifies how likely the observed data (or more extreme data) is if the null hypothesis were true.
Card 27
Significance Level (Alpha, α)
Answer
The predetermined threshold probability below which the null hypothesis will be rejected. It represents the maximum acceptable probability of making a Type I error.
Commonly set at 0.05 or 0.01, the significance level is chosen before data collection and provides the standard against which the p-value is compared for making a decision about the null hypothesis.
Card 28
Type I Error
Answer
The error of rejecting a null hypothesis when it is actually true, also known as a false positive. Its probability is equal to the significance level (alpha, α).
Think of a Type I error as concluding a treatment works when it actually doesn't, or finding a difference that isn't truly there; it's a 'false alarm'.
Card 29
Correlation Coefficient
Answer
A numerical measure that quantifies the strength and direction of a linear relationship between two quantitative variables. Its value ranges from -1 to +1, where -1 indicates a perfect negative linear relationship, +1 indicates a perfect positive linear relationship, and 0 indicates no linear relationship.
Remember that correlation does not imply causation; a strong correlation only shows that two variables move together, not that one directly causes the other.