Some Advanced Model Selection Topics for Nonparametric/Semiparametric Models with High-Dimensional Data
MetadataShow full item record
Model and variable selection have attracted considerable attention in areas of application where datasets usually contain thousands of variables. Variable selection is a critical step to reduce the dimension of high dimensional data by eliminating irrelevant variables. The general objective of variable selection is not only to obtain a set of cost-effective predictors selected but also to improve prediction and prediction variance. We have made several contributions to this issue through a range of advanced topics: providing a graphical view of Bayesian Variable Selection (BVS), recovering sparsity in multivariate nonparametric models and proposing a testing procedure for evaluating nonlinear interaction effect in a semiparametric model. To address the first topic, we propose a new Bayesian variable selection approach via the graphical model and the Ising model, which we refer to the ``Bayesian Ising Graphical Model'' (BIGM). There are several advantages of our BIGM: it is easy to (1) employ the single-site updating and cluster updating algorithm, both of which are suitable for problems with small sample sizes and a larger number of variables, (2) extend this approach to nonparametric regression models, and (3) incorporate graphical prior information. In the second topic, we propose a Nonnegative Garrote on a Kernel machine (NGK) to recover sparsity of input variables in smoothing functions. We model the smoothing function by a least squares kernel machine and construct a nonnegative garrote on the kernel model as the function of the similarity matrix. An efficient coordinate descent/backfitting algorithm is developed. The third topic involves a specific genetic pathway dataset in which the pathways interact with the environmental variables. We propose a semiparametric method to model the pathway-environment interaction. We then employ a restricted likelihood ratio test and a score test to evaluate the main pathway effect and the pathway-environment interaction.
- Doctoral Dissertations 
Showing items related by title, author, creator and subject.
A descriptive study of the supervisory model used in a large metropolitan school system : the triad support teacher model of Baltimore City, Maryland Hall, Patricia Holmes (Virginia Tech, 1991-12-15)Effective supervision can improve the quality of teaching and learning in the classroom. Researchers in educational theory agree that supervision exists for the primary purpose of improving instruction. Wiles defined supervision ...
Amini Moghadam, Shahram (Virginia Tech, 2012-07-16)The primary aim of this research is to shed more light on the issue of model uncertainty in applied econometrics in general and cross-country growth as well as happiness and well-being regressions in particular. Model ...
Chen, Qian (Virginia Tech, 2007-07-13)The construction industry's overall project performance is significantly reduced by numerous interface issues that also hinder its industrialization. Interface Management (IM) is becoming critical to the success of ...