Model Validation and Potential Solutions
NOTE: Except in cases of complex calculations, we use brackets [ ] to indicate “functions of” and parentheses ( ) to indicate “multiplication.”
SE[Beta_1-hat] = the standard error of the estimated slope Beta_1-hat. There is no multiplication!
Beta_1-hat(AGE) = the multiplication of estimated slope Beta_1-hat and the variable AGE.
Introduction and Links to Materials
In Unit 3 we will spend a significant amount of time covering the details regarding multiple linear regression. Many of the basic ideas are direct extensions of simple linear regression and many skills in interpretation and modeling will translate, at least partially, to other regression models we will cover and that you may learn in the future.
We will be using PROC GLM instead of PROC REG in this course although many analyses can be completed using PROC REG if you are willing to code all categorical variables manually. We will learn in this unit how PROC GLM can be used to correctly code categorical variables for us in our analyses which is the main reason we prefer PROC GLM for multiple linear regression in this course.
Useful SAS Procedures
- PROC GLM
- CLASS statement in PROC GLM
- Other procedures as needed for exploratory data analysis
Consider the following materials from Penn State STAT 501 as your textbook materials for this content.
Review Penn State materials with a focus on the definitions, concepts, and interpretations. You do not need to understand the mathematical details or be able to calculate regression models by hand (although you are expected to be able to work with models and ANOVA tables requiring simple mathematical calculations). They don’t cover multiple linear regression in exactly the same was we do HOWEVER:
- Their coverage of assumptions and transformations is better than ours!
One difference in their materials of importance is that they let p = the number of parameters in the model (including the intercept) and we let p = the number of x-variables in our model. You should convince yourself that these approaches are equivalent and stick with whichever you like best for your own work. We will not ask any questions which will require one method over the other.
PENN STATE STAT 501 Materials – required textbook reading for this material
Note: If you click on “Printer Friendly Version” in the main lesson page it will show all pages in that lesson. These are provided here after the main lesson link.
We will be using PROC GLM for simple and multiple linear regression so let’s look at some PROC GLM documentation including examples.
SAS Documentation: As we continue into multiple linear regression the examples we asked you to review should start to make more sense. They are linked here again along with more content about GLM and common statements.
PHC 6053 Videos
The following presentation was created for future video plans for this content.