 Research
 Open Access
 Published:
Bayesian methods for expressionbased integration of various types of genomics data
EURASIP Journal on Bioinformatics and Systems Biology volume 2013, Article number: 13 (2013)
Abstract
We propose methods to integrate data across several genomic platforms using a hierarchical Bayesian analysis framework that incorporates the biological relationships among the platforms to identify genes whose expression is related to clinical outcomes in cancer. This integrated approach combines information across all platforms, leading to increased statistical power in finding these predictive genes, and further provides mechanistic information about the manner in which the gene affects the outcome. We demonstrate the advantages of the shrinkage estimation used by this approach through a simulation, and finally, we apply our method to a Glioblastoma Multiforme dataset and identify several genes potentially associated with the patients’ survival. We find 12 positive prognostic markers associated with nine genes and 13 negative prognostic markers associated with nine genes.
1 Introduction
The central dogma of molecular biology summarizes the steps involved in the passage of genetic information at a molecular level: DNA is transcribed to messenger RNA (mRNA), which is then translated to a protein, which carries out a specific action in an organism. In addition, there are also other alterations and interferences, such as epigenetic factors, that can occur at the DNA and/or mRNA levels which affect the ultimate expression of a given gene. In this paper, we consider methylation (which occurs at the DNA level and typically results in a silencing of the gene), copy number (which describes an attribute at the DNA level that affects mRNA expression), and mRNA expression (which affects protein expression); these subsequently affect a clinical phenotype (e.g., survival) (see Figure1). In addition, it is believed that the mechanism of cancer development is complex and involves multiple genes[1]. It is known that genes interact and are related through certain pathways, and in this paper, we focus on genes from important signaling pathways that influence cancer progression and development[2].
Current technologies allow us to obtain data from the abovementioned platforms (and many others) for each gene involved in the investigations. The Cancer Genome Atlas (TCGA) is a project that began in 2006 to gather comprehensive genomic data using multiple platforms on over 20 types of cancer[3]. The increasing availability of such data has motivated the development of methods that seek to improve estimation and prediction regarding genomic effects on cancer outcomes by integrating data from multiple platforms in a single analysis. The incorporation of information from more than one platform has the potential to increase power and lower false discovery rates in identifying markers related to clinical outcomes for cancer patients[4]; such improvements would deepen our understanding of how cancer develops and spreads, offering researchers valuable insight regarding the development of drugs and procedures intended to prevent or inhibit cancer development.
Some integration techniques consider different platforms sequentially and then draw conclusions from the combination of results. For example, the TCGA Research Network performed a largescale study of ovarian cancer data, including specific platforms such as gene mutations, copy number, mRNA expression, miRNA expression, and DNA methylation. Within each platform, they compared normal and tumor cells to identify significant genes and combined the information obtained from different platforms to understand the deeper biology behind the cancer mechanisms, including gene interactions. Using the prevalence of significant genes, they also identified influential pathways, including the RB1 and PI3K/RAS pathways[5]. TCGA Research Network conducted a similar style study on Glioblastoma Multiforme (GBM) data and, among other things, discovered a previously unknown link between MGMT methylation and the mutation spectra of mismatch repair genes through the integration of mutation, methylation, and clinical treatment data[6]. These methods provide insight into the roles and interactions of genes as related to the development and outcome of the disease.
Another type of integrative method proposes incorporating multiple platforms in a single model. Such approaches must face the challenges of high dimensionality and complex biological relationships both within and between platforms. One such approach is iCluster, proposed by Shen et al., which is a joint latent variable modelbased clustering method that integrates data from multiple genomic platforms to cluster samples into subtypes. iCluster achieves reduced dimension of the data, and it is shown to identify potentially novel subtypes of breast cancer and lung cancer[7]. However, this method does not directly model the biological relationships among platforms; in addition, it is an unsupervised method, while our approach is supervised. Tyekucheva et al. suggest a method that includes multiple platforms as predictors in a logistic regression model (with phenotype as the response), and they show that incorporating multiple platforms yields more power to detect differentially expressed genes than approaches that only use a single platform[8]. As with iCluster, this approach accounts for dependence between platforms, but it does not directly take into account their biological relationships.
Another method, proposed by Lanckriet et al., first represents data from each platform (such as primary protein sequence, proteinprotein interaction, and mRNA expression) via a kernel function and then combines the kernels in a classification model (predicting, for example, protein type). It is shown that this method outperforms methods based on a single kernel from any one data platform[9]. However, this method does not directly model the relationships among the platforms, and kernel representations of the marker effects on the clinical outcomes are not directly interpretable. Liu et al. suggest another approach that integrates clinical covariates and multiple gene expressions (from a common pathway) to predict a continuous outcome through a semiparametric model; the covariates are modeled parametrically, and the pathway effect is modeled through least squares kernel machines (LSKM) (either parametrically or not). The covariate as well as pathway effects can be estimated, and the pathway effect can be tested for significance. The nonparametric LSKM regression allows for complicated interactions between genes[10], but this method only incorporates a single genomic platform (and accounts for its internal biological relationships). Recently, Wang et al. proposed an integrative Bayesian analysis of genomics data (iBAG) framework that models the biological relationships between two platforms[4]. This approach involves a global gene search and uses variable selection via the Bayesian lassobased shrinkage priors to deal with the high dimensionality of the data.
In this paper, we introduce a generalized version of iBAG that integrates data from an arbitrary (multiple) number of genomic platforms using a hierarchical model that incorporates the biological relationships among them. We focus our analysis on genes from several important cancer signaling pathways and integrate mRNA, methylation, and copy number data to predict survival in GBM patients. In addition, we reduce dimension by regressing the clinical outcome on latent scores of the platforms (see Section 2.1 for details). To improve effect size estimation and to achieve sparsity, we use a NormalGamma (NG) prior for the effects, which increases flexibility in the estimation as compared to the Laplace prior of the Bayesian lasso[11] (see Section 2.2 for further discussion). Section 3 illustrates our methodology on a synthetic example; analysis of GBM data is presented in Section 4; and conclusions are drawn in Section 5.
2 A multivariate iBAG model
Our construction of a multivariate iBAG model employs a twocomponent hierarchical model where the first component can be considered as the mechanistic model and the second can be considered as the clinical model. In the first stage mechanistic model, we partition each gene’s expression into the factors explained by methylation, copy number, and other (unknown/unmeasured) causes using a principal componentbased regression model. Subsequently, we include these factors as predictors in the second stage clinical model, thus finding not only those genes whose expression is directly related to clinical outcome, but also expression effects driven by methylation, copy number, or other mechanisms. We explain the construction of each of these components below.
2.1 Mechanistic model
Let n = number of patients, J = number of platforms being integrated, and p_{ j } = number of genes from platform j. The mechanistic model for each gene can be expressed as:
where each of the terms are defined as follows:

mRNA_{ i } is the level of gene expression for gene i (where i = 1,…,max(p_{ j }); j = 1,…,J) and is of dimension (n × 1).

M_{ i } is the part of gene_{ i } expression that is attributed to methylation, and is of dimension (n × 1). Specifically, M_{ i } is the product of some methylation predictor and a fitted coefficient. Details are below.

CN_{ i } is the part of gene_{ i } expression that is attributed to changes in copy number, and is of dimension (n × 1). Specific calculation is similar to M_{ i } – see below.

O_{ i } represents the ‘other’ (remaining) part of the gene expression that is explained by something other than methylation or copy number, and is of dimension (n × 1).
Since the raw methylation and copy number data for any given gene can contain multiple (up to 40 in our data) values from different markers within that gene, to estimate each of the components M_{ i }, CN_{ i }, and O_{ i }, we first carry out two principal component analyses (PCA) for gene_{ i }: one each for the methylation and copy number data, and in each case, we keep the number of principal components that retain ≥ 90% of the total variation. We then regress mRNA_{ i } on the methylation and copy number PC scores. We use the estimated pieces and the corresponding residuals from this regression to estimate the vectors${\mathrm{M}}_{i}={\sum}_{k=1}^{K}{X}_{i,k}^{M}{B}_{k}^{M}$ (where${X}_{i,k}^{M}$ is the methylation value for gene i with K = 1 if there is only one methylation marker for that gene, or the methylation score for principal component k for gene i if there are multiple methylation markers for gene i, and${B}_{k}^{M}$ is the vector of regression coefficients),${\text{CN}}_{i}={\sum}_{r=1}^{R}{X}_{i,r}^{\mathit{\text{CN}}}{B}_{r}^{\mathit{\text{CN}}}$ (where${X}_{i,r}^{\mathit{\text{CN}}}$ is the copy number value for gene i with R = 1 if there is only one copy number marker for that gene, or the copy number score for principal component r for gene i if there are multiple copy number markers for gene i, and${B}_{r}^{\mathit{\text{CN}}}$ is the vector of regression coefficients), and O_{ i } = residuals. This process is repeated for each gene independently.
2.2 Clinical model
The clinical model component of our construction relates the effect of the mechanistic parts of the genes (as estimated above) to a clinical outcome of interest (e.g., survival, in our context) and can be written as:
where Y denotes the clinical outcome, β_{ j } are the effects of platform j on Y, and ε is the error term. The covariates in the model {M, CN, O} are the vectorized gene expression effects attributed to methylation, copy number, and other sources, respectively, and are estimated from the mechanistic model. In essence, our clinical component jointly (additively) models the effects of all the gene expressions and their components  derived from different sources (methylation/copy number)  in a unified manner. When the clinical response is survival, we use an accelerated failure time (AFT) model, taking Y to be log(survival)[12].
Our goal is to find a list of significant genes that affect the outcome via the various mechanisms; hence, efficient estimation of β = {β_{1},β_{2},β_{3}} is of primary interest. One route would be to simply fit a least squares regression to estimate the parameters. However, the number of predictors is large compared to the number of samples, and, more importantly, we expect our solution to be very sparse since only a few genes will be related to clinical response; hence, least squares would overfit the data and yield less accurate results as compared to approaches that induce sparsity by shrinkage/penalization. We illustrate this fact in our simulation in Section 3.
To induce shrinkage/penalization, we follow a Bayesian approach and specify particular prior distributions for each model parameter in the clinical model and sample from the posterior distribution using Markov Chain Monte Carlo (MCMC). There are several priors known to achieve sparsity and facilitate Bayesian variable selection, which we will discuss briefly. One option is to simply put vague Normal(0,∞) priors on each regression coefficient. This is equivalent to doing least squares regression and is impossible in cases where there are more variables than data points, because singular solutions arise. A natural extension is to place proper meanzero Normal priors on the coefficients, which is equivalent to ridge regression. Although accommodating more predictors than data points and facilitating shrinkage, the type of shrinkage is linear which is not desirable in the current settings. This linear shrinkage leads to more shrinkage and thus greater bias for larger coefficients, while in this setting, we desire the opposite: less shrinkage for large (significant) coefficients and greater shrinkage for smaller (nonsignificant) ones. This type of nonlinear shrinkage can be accomplished by various priors. One is the ‘spike and slab’ prior consisting of a mixture of a point mass at zero (the spike) and a Normal (the slab). Although this can accommodate a large number of predictors and avoids linear shrinkage, the shrinkage asymptotes to a constant which still results in attenuation of the truly large effects, something we want to avoid. In addition, computational complications and difficulties accompany the use of spike and slab priors. As we show below, all but one of our complete conditional distributions are in closed form, so we can avoid the computational difficulties associated with the spike and slab method, as well as the attenuation of large effects, by utilizing continuous shrinkage priors.
A widely known method that places a continuous sparsity prior on the regression coefficients is the Bayesian lasso[13], which is incorporated by assigning a double exponential (i.e., Laplace) prior to β. When posterior modes are used as the coefficent estimates, this process yields the same solutions as Tibshirani’s lasso[14]. The Bayesian lasso has proven to perform well in conducting adaptive shrinkageinduced sparsity, but the single hyperparameter formulation does not allow for enough flexibility to estimate the true size of potentially large, nonzero effects. Instead, these effect estimates are shrunk toward zero along with the smaller effects[11]. An alternate class of priors we use and discuss is the NormalGamma (NG) prior distribution for β. Incorporating this continuous prior not only provides shrinkage of the coefficients but the extra hyperparameter in the NG prior construction facilitates more adaptability in the estimated shrinkage relative to the Bayesian lasso[13]  with the NG, the larger effects are shrunk less than the smaller effects[15], thus leading to improved estimation[11]. In summary, the NG prior is extremely advantageous in our situation, since it delivers the sparsity we need, while leaving larger effects mostly unshrunk, thus aiding our estimation of the important effects.
For our method, we assign a NormalGamma (NG) prior distribution for each β_{ j }. Our complete hierarchical clinical model can be written as:
where$\stackrel{~}{p}={\sum}_{j=1}^{J}{p}_{j}$ is the total number of predictors in the model. (Note that the double exponential prior of the Bayesian lasso would be constructed by assigning β_{j,i}ψ_{j,i} ∼ Normal(0,ψ_{j,i}) and ψ_{j,i} ∼ Exponential(λ_{ j }). The single parameter in the exponential prior (λ_{ j }) is the reason such a construction has limited flexibility as compared to the NG prior which is parameterized by both λ_{ j } and γ_{ j }.) With the NG formulation as given above, the complete conditionals for most parameters are available in closed form  we can use Gibbs sampling to update all parameters except λ_{ j }, which we update using a MetropolisHastings random walk step. More details for drawing MCMC samples are available in Appendix B.
2.3 Gene selection
Given the posterior samples from the MCMC, we determine which genes are significantly related to clinical outcome using a method based on the median probability model[16]. First, we define a minimum effect size which is driven by practical considerations. Since we are analyzing survival data, we use AFT models using log(survival) as the response; thus, a δfold or larger change in survival for a unit increase in a predictor corresponds to a β_{j,i} outside the region (log(1  δ), log(1 + δ)), where β_{j,i} is the regression coefficient for platform j of gene i. Denote this region$({\delta}_{}^{\ast},{\delta}_{+}^{\ast})$. (In our following analyses, we use δ = 0.05 which corresponds to a 5% change in survival time.) If S is the number of MCMC samples and${\beta}_{j,i}^{(s)}$ is the β_{j,i} sample from iteration s, then${p}_{+}({x}_{j,i})={\sum}_{s=1}^{S}\mathbf{I}({\beta}_{j,i}^{(s)}>{\delta}_{+}^{\ast})/S$ is the posterior probability that β_{j,i} is higher than the practical cutoff${\delta}_{+}^{\ast}$. Similarly,${p}_{}({x}_{j,i})={\sum}_{s=1}^{S}\mathbf{I}({\beta}_{j,i}^{(s)}<{\delta}_{}^{\ast})/S$ is the posterior probability that β_{j,i} is lower than the practical cutoff${\delta}_{}^{\ast}$. We flag a gene as ‘significant’ if p_{+}(x_{j,i}) > 0.5 or if p_{−}(x_{j,i}) > 0.5.
Algorithm 1 provides a concise summary of implementing the multivariate iBAG model and conducting gene selection.
Algorithm 1 Method implementation
3 Simulation
We investigate the shrinkage properties of our Bayesian penalized regression formulation of the clinical model as compared to least squares regression, Bayesan lasso, frequentist lasso, and frequentist elastic net through a simulation. We simulate a training dataset with 90 predictors (J = 3 platforms with p_{1} = p_{2} = p_{3} = 30 predictors from each), where 30 randomly selected β_{j,i}’s are set exactly to 0 and the other 60 are sampled from a Laplace(μ = 0, b = 1/7) distribution; this reflects the effective sparsity we expect to see in our data. The other settings for the simulated data are n = 100, σ^{2} = 1, each X entry is from Normal(0,1), and Y = Normal(X β,σ^{2}I_{ n }). The test dataset used to assess performance is simulated with the same settings as the training data, but n = 400. We applied our method for estimating the parameters in the clinical model, using 10,000 iterations of the Gibbs sampler with 500 for a burnin period. For both the frequentist lasso and elastic net, we ran the simulation with two standard choices for the penalty parameter λ: (1) ‘1 SE’ where we used the largest λ with cross validation error within one standard error of the minimum cross validation error and (2) ‘min’ where we used the λ with minimum error (from cross validation). For elastic net, we set the mixing parameter (that controls the mixture of penalties) to 0.5. The results of our method are compared to those of the other methods in Table1.
We see that our method gives a good estimate of σ^{2} (recall σ^{2} = 1). We also note that the least squares regression yields coverage probabilities that are too high, while the frequentist coverage probabilities of the Bayesian credible intervals are close to the nominal levels. (Note that for the frequentist lasso and elastic net, it is not possible to obtain standard errors for the coefficients set to 0, and therefore, we cannot construct the CI’s.) For all methods (other than least squares), the MSE ratio is less than 1 for the training data but much greater than 1 for the test data; this is consistent with the idea that in this high dimensional setting with expected sparsity, least squares tends to overfit the training data, while methods that perform shrinkage lead to improved estimation on the test data and thus yield results more applicable to the overall population. Considering that the MSE ratio is the mean squared error from least squares divided by the MSE from the respective method, we see that our method has the best (largest) MSE ratio on test data, which for our purposes is the most relevant comparison criterion.
We also see excellent shrinkage properties of our method in Figure2; most least squares coefficient estimates (which are the maximum likelihood estimates) are far from the true parameter values, while the posterior means from our method shrink these estimates closer to the true values. The nonlinear shrinkage and flexibility provided by the NG prior facilitate more shrinkage near 0 without severe attenuation of the estimates for truly large regression coefficients.
4 Integrative analysis of GBM data
GBM is one of the most common and most malignant brain tumors. The American Cancer Society estimates that in the year 2013, there will be 23,130 new cases of brain and other nervous system cancers in the USA and that 14,080 Americans will die from such cancers[17]. GBM tumors make up 17% of all primary brain tumors[18], and prognosis is typically very poor; a study with 7,259 patients, each diagnosed with GBM from 2005 to 2008, found a median survival time of 14.6 months for patients who received tumordirected surgery and radiation therapy and a median survival time of 2.9 months for patients who did not receive any radiation treatment[19]. Treatment options include surgery, radiation, and/or chemotherapy, but even for a patient receiving more than one of these treatments, the outlook is dismal at best. Finding prognostic biomarkers related to cancer development and patient survival is an important issue, and GBM was one of first cancers to be studied in TCGA. The data currently available contains information from multiple molecular platforms (genomic/epigenomic/transcriptomic) as well as clinical data on several hundred tumor samples (approximately 500).
The availability of such extensive genomic data has prompted several studies using the TCGA GBM data, and fortunately, there continue to be discoveries of biomarkers that aid in predicting survival and identifying subtypes of GBM. One such study conducted by Verhaak et al. combined gene expression data from multiple types of microarray assays to classify tumors into four distinct subtypes (each responding differently to therapy) and to discover which gene expression levels had a significant impact on the classification. Other platforms were also used, such as copy number and mutations, in separate analyses to test for associations with subtype[20]. Another study by Noushmehr et al. used the available GBM DNA methylation data to identify a subgroup of GBM tumors associated with a significantly longer survival time[21]. In our integrative analysis, we use 163 matched tumor samples that have been assayed by expression, methylation, and copy number platforms as described below. Each of these samples has an uncensored survival time (in days), and our aim is to identify prognostic biomarkers.
4.1 Description of data
Our copy number data is level 2 data from the HG_CGH_244A platform; it is the normalized signal for copy number alterations of aggregated regions per probe. Our methylation data is level 3 data from the HumanMethylation27K arrays; it is the methylated sites along a gene (probe level data). Our expression data is level 3 data (summarized per gene) from the Affymetrix profiled HT_HG_U133A platform[22].
We focus our analysis on data corresponding to 49 genes implicated in important signaling pathways in GBM (RTK/PI3K, P53, and RB pathways[2]), using the following structure:

1.
OurSurvival (163 × 1), containing days of survival after diagnosis for each patient.

2.
OurMRNA (163 × 49), containing mRNA expression levels for each gene (columns) for each patient (rows).

3.
OurMeth (163 × 176), containing data on the methylation markers (columns) for each patient (rows). There can be multiple (ranging from 1 to 21) methylation markers per gene, and the columns are ordered by gene.

4.
OurCopyNumber (163×524), containing copy number data (columns) for each patient (rows). Again, there are multiple (ranging from 1 to 43) values per gene, and the columns are ordered by gene.
One gene has no methylation data, so we remove that column from the X matrix, which essentially sets M_{ i } to be 0 for that gene. Any effect that may be due to methylation for that gene would then be captured by the ‘other’ predictor in the clinical model. After standardizing the predictors and imputing the (few) missing values, we model the data using an AFT model with log survival times as the outcome and apply our method of estimating the parameters of the iBAG model.
4.2 Results using iBAG model
After applying our method to the GBM data, we then use the method discussed in Section 2.3 to determine the significant markers using δ = 0.05 (corresponding to a 5% change in survival time). Figures3 and4 show the posterior probabilities of the effect (β_{j,i}) being greater than${\delta}_{+}^{\ast}$ and less than${\delta}_{}^{\ast}$, respectively. Figure5 depicts the posterior means of the β_{j,i}’s and also indicates which were flagged as significant. We find 25 markers to be significant, 12 with positive effects on survival (more expression attributed to that platform, better prognosis) and 13 with negative effects (more expression attributed to that platform, poorer prognosis). The genes with the 12 positive markers were PDGFRB, FGFR1, CCND2, PIK3R2, IRS1, CDKN2C, TP53, PIK3CA, and PDGFRA. The genes PDGFRB, FGFR1, and CCND2 were determined to be related to clinical outcome through methylation effects, while expressions of PIK3R2, IRS1, CDKN2C, and TP53 were related to clinical outcome through copy number. For PIK3CA, PDGFRA, PDGFRB, CCND2, and TP53, gene expression was related to clinical outcome through some other unspecified mechanism. The genes with the 13 negative markers were IGF1R, FGFR2, ARAF, GRB2, FGFR1, HRAS, MDM2, PDPK1, and RAF1. The first four were related to clinical response through methylation, while FGFR1, HRAS, ARAF, and MDM2 were related through copy number, and PDPK1, IGF1R, FGFR2, RAF1, and MDM2 were related through some mechanism other than methylation or copy number. Note that eight genes (IGF1R, PDGFRB, FGFR1, FGFR2, ARAF, CCND2, MDM2, and TP53) are found to be significant on two or more different platforms. We have not only identified 17 genes as having a significant effect on survival (Table2), but we have also determined which platform(s) of those genes is (are) modulating the effect.
4.3 Biological interpretation
There are a total of 17 genes found to affect the expression of glioblastoma tumors significantly. Of these, nine genes are negatively affecting the survival and nine genes are affecting the survival positively. The positive and negative prognostic markers are reviewed within the context of glioblastoma biology in this section.
Negative prognostic markers: Fibroblast growth factor pathway signaling is associated with significant tumor enhancement in glioblastoma[23]. Fibroblast growth factor receptors FGFR1 and FGFR2 play an oncogenic role in various tumor types and can be targeted by multiple small molecules in cancer therapy[24]. FGFR1 expression can be regulated by methylation level of the upstream CpG island[25]. Hypermethylation of FGFR1 would provide positive effects by reducing the expression level of FGFR1 and thus appear to be affecting the survival in both ways. Insulinlike growth factor receptor 1 (IGF1R) is a wellknown target to treat GBM and has been found to be associated with astrocytoma and meningioma as well[26]. It is also associated with antiEGFR resistance in GBM and is a pancancer biomarker connected with many different tumor types[27, 28]. MDM2 is a wellknown oncogene and inhibitor of the tumor suppressor TP53. Previous studies in glioblastoma using expression and copy number platforms indicated the abnormal overexpression and amplification of MDM2[29, 30]. ARAF is a serine/threonine protein kinase of RAF family, known to stabilize the heterodimerization of RAF proteins, BRAF and CRAF[31]. Its role and overexpression are observed in other tumors but are not explored in the context of glioblastoma[32]. Growth factor receptorbound protein 2 (GRB2) is involved in RAS signaling pathway and known to be associated with EGFR[33]. GRB2 is an interacting partner of EGFRvIII, a common mutated variant of EGFR in the molecular signaling of EGFRdriven glioblastoma[34, 35].
Positive prognostic markers: The tumor suppressor gene TP53 is a positive prognostic marker as expected. The Cyclindependent kinase inhibitor CDKN2C, a known tumor suppressor of glioblastoma, is also identified as a positive marker[36]. Plateletderived growth factors (PDGF) receptors PDGFRA and PDGFRB show positive survival effects, whose oncogenic role is well established in the context of glioma[37, 38]. These PDGF receptors are the representative genes of the proneural subtype of glioblastoma[20, 39]. Interestingly, the proneural subtype of glioblastoma is enriched in oligodendroglioma and has higher survival rates compared to other subtypes of glioblastoma[40]. The insulin receptor substrate gene IRS1 is shown to be one of the representative candidates for mesenchymal subtype of GBM with poor survival[41]. The role of IRS1 is not clear, given that we found it to be a positive marker in our analysis. Overall, the positive markers are generally enriched in the proneural subtype of glioblastoma, which was found to have prolonged survival[20].
5 Conclusions
In this article, we present a hierarchical Bayesian model that integrates data from multiple genomic platforms, incorporating information about the platforms’ biological relationships in order to better identify genes that are critical to patient survival and to additionally provide mechanistic information on the manner of their effect. In summary, the key advantages of our method include (1) multiple platforms are integrated in a single model; (2) the biological relationships between platforms are taken into account by the model; (3) high dimensional data can be handled easily, with shrinkage priors; (4) the NG prior on the predictors allows for flexible shrinkage of the parameter estimates; (5) the model can be extended to incorporate more platforms, as long as the underlying biological relationships are well understood; and (6) we have the ability to not only identify genes significant to patient survival but also gain mechanistic information on the manner by which the gene expression is related to outcome.
Applying our methodology to a GBM dataset from TCGA, our method identified several genes with effects that have a significant impact on survival time. In addition, we identified whether each gene was related to clinical outcome through methylation, copy number, or some other mechanism. This is especially advantageous in investigating the biological mechanisms of cancer development and progression, and in subsequent development of novel therapeutic strategies.
Although beyond the scope of this paper, two areas of future investigation might include (1) relaxing the parametric assumptions by using generalized additive models instead of linear models or substituting specified parametric nonlinear models if they are justified by the science, and (2) dynamic modeling, which would require different types of data and further modeling assumptions to capture complex patterns of feedback loops both within and between platforms.
Appendices
Appendix A Data imputation
Since the percentage of missing data is so low (∼5% for methylation and ∼0.1% for copy number), we choose to do imputation using the following algorithm for both the methylation data and the copy number data: (1) For each marker, replace any NA’s with the mean of the other patients. Call this resulting matrix Temp. (2) Use Temp to calculate a correlation matrix between markers. (3) For each marker with missing value(s), regress it on the three markers which it is most highly positively correlated with (using the Temp matrix for the predictors to avoid further complications from missing data). (4) Substitute this predicted value for the missing value in the original matrix.
Appendix B Complete conditionals
In the MetropolisHastings update step, the proposed value is${\lambda}_{j}^{\ast}=exp({\sigma}_{\lambda}^{2}z){\lambda}_{j}$ where z ∼ Normal(0,1) and the tuning parameter${\sigma}_{\lambda}^{2}$ is chosen to result in an acceptance rate between 20% and 30%. The acceptance probability is then$min\left\{1,\frac{\pi ({\lambda}_{j}^{\ast})}{\pi ({\lambda}_{j})}{\left(\frac{\mathrm{\Gamma}({\lambda}_{j})}{\mathrm{\Gamma}({\lambda}_{j}^{\ast})}\right)}^{{p}_{j}}{\left({(2{\gamma}_{j}^{2})}^{{p}_{j}}{\prod}_{i=1}^{{p}_{j}}{\psi}_{j,i}\right)}^{{\lambda}_{j}^{\ast}{\lambda}_{j}}\left(\frac{{\lambda}_{j}^{\ast}}{{\lambda}_{j}}\right)\right\}$ where$\pi ({\lambda}_{j})={(1/{\lambda}_{j})}^{\xe3}exp\{\stackrel{~}{b}{\gamma}_{j}^{2}/(2{\lambda}_{j})c{\lambda}_{j}\}$, the prior for λ_{ j }.
Initial values and hyperparameters
The initial values and hyperparameters are chosen as follows:

The hyperparameters for σ^{2} are a = b = 0.001, so as to be uninformative.

The hyperparameter for λ_{ j } is c = 1[11].

The hyperparamters for${\gamma}_{j}^{2}$ are$\stackrel{~}{a}=2$ and$\stackrel{~}{b}$ = the mean of the least squares$\hat{{\beta}_{j,i}^{2}}$[11].

The initial β is the estimate from the frequentist lasso with a single shrinkage parameter.

The initial σ^{2} is the mean sum of squares from the frequentist lasso.

Each initial λ_{ j }, ψ_{j,i}, and${\gamma}_{j}^{2}$ is set to 1.
References
 1.
Kanu OO, Hughes B, Di C, Lin N, Fu J, Bigner DD, Yan H, Adamson C: Glioblastoma multiforme oncogenomics and signaling pathways. Clin. Med. Oncol 2009, 3: 3952.
 2.
Pathway analysis of genetic alterations in glioblastoma (TCGA) 2012. [Memorial SloanKettering Cancer Center]. Accessed 9 August 2012. http://cbio.mskcc.org/cancergenomics/gbm/pathways/
 3.
Program overview 2012. [The Cancer Genome Atlas]. Accessed 9 August 2012 http://cancergenome.nih.gov/abouttcga/overview
 4.
Wang W, Baladandayuthapani V, Morris JS, Broom BM, Manyam G, Do KA: iBAG: integrative Bayesian analysis of highdimensional multiplatform genomics data. Bioinformatics 2013,29(2):149159. 10.1093/bioinformatics/bts655
 5.
Bell D, Berchuck A, Birrer M, Chien J, Cramer D, Dao F, Dhir R, DiSaia P, Gabra H, Glenn P, Godwin A, Gross J, Hartmann L, Huang M, Huntsman D, Iacocca M, Imielinski M, Kalloger S, Karlan B, Levine D, Mills G, Morrison C, Mutch D, Olvera N, Orsulic S, Park K, Petrelli N, Rabeno B, Rader J, Sikic B, et al.: Integrated genomic analyses of ovarian carcinoma. Nature 2011,474(7353):609615. 10.1038/nature10166
 6.
McR endon L, Friedman A, Bigner D, Van Meir EG, Brat DJ, Mastrogianakis GM, Olson JJ, Mikkelsen T, Lehman N, Aldape K, Yung WK, Bogler O, Weinstein JN, VandenBerg S, Berger M, Prados M, Muzny D, Morgan M, Scherer S, Sabo A, Nazareth L, Lewis L, Hall O, Zhu Y, Ren Y, Alvi O, Yao J, Hawes A, Jhangiani S, Fowler G, et al.: Comprehensive genomic characterization defines human glioblastoma genes and core pathways. Nature 2008,455(7216):10611068. 10.1038/nature07385
 7.
Shen R, Olshen AB, Ladanyi M: Integrative clustering of multiple genomic data types using a joint latent variable model with application to breast and lung cancer subtype analysis. Bioinformatics 2009,25(22):29062912. 10.1093/bioinformatics/btp543
 8.
Tyekucheva S, Marchionni L, Karchin R, Parmigiani G: Integrating diverse genomic data using gene sets. Genome Biol 2011,12(10):R105. 10.1186/gb20111210r105
 9.
Lanckriet GR, De Bie T, Cristianini N, Jordan MI, Noble WS: A statistical framework for genomic data fusion. Bioinformatics 2004,20(16):26262635. 10.1093/bioinformatics/bth294
 10.
Liu D, Lin X, Ghosh D: Semiparametric regression of multidimensional genetic pathway data: least squares kernel machines and linear mixed models. Biometrics 2007, 63: 10791088. 10.1111/j.15410420.2007.00799.x
 11.
Griffin JE, Brown PJ: Inference with normalgamma prior distributions in regression problems. Bayesian Anal 2010, 5: 171188. 10.1214/10BA507
 12.
Wei LJ: The accelerated failure time model: A useful alternative to the cox regression model in survival analysis. Stat Med 1992,11(14–15):18711879.. http://dx.doi.org/10.1002/sim.4780111409.
 13.
Park T, Casella G: The Bayesian lasso. J Am. Stat. Assoc 2008,103(482):681686. 10.1198/016214508000000337
 14.
Tibshirani R: Regression shrinkage and selection via the lasso. J. R. Stat Soc. Series B (Methodological) 1996, 58: 267288.
 15.
Griffin JE, Brown PJ: Structuring shrinkage: some correlated priors for regression. Biometrika 2012,99(2):481487. [. http://EconPapers.repec.org/RePEc:oup:biomet:v:99:y:2012:i:2:p:481487] []. 10.1093/biomet/asr082
 16.
Barbieri MM, Berger JO: Optimal predictive model selection. Ann. Stat 2004,32(3):870897. 10.1214/009053604000000238
 17.
American Cancer Society: American Cancer Society: Cancer Facts and Figures 2013. Atlanta, GA: American Cancer Society; 2013.
 18.
Glioblastoma 2013. [American Brain Tumor Association]. Accessed 6 June 2013 http://www.abta.org/understandingbraintumors/typesoftumors/glioblastoma.html
 19.
Johnson DR, O’Neill BP: Glioblastoma survival in the United States before and during the temozolomide era. J. Neurooncol 2012,107(2):359364. 10.1007/s1106001107494
 20.
Verhaak RG, Hoadley KA, Purdom E, Wang V, Qi Y, Wilkerson MD, Miller CR, Ding L, Golub T, Mesirov JP, Alexe G, Lawrence M, O’Kelly M, Tamayo P, Weir BA, Gabriel S, Winckler W, Gupta S, Jakkula L, Feiler HS, Hodgson JG, James CD, Sarkaria JN, Brennan C, Kahn A, Spellman PT, Wilson RK, Speed TP, Gray JW, et al.: Integrated genomic analysis identifies clinically relevant subtypes of glioblastoma characterized by abnormalities in, PDGFRA, IDH1, EGFR, and NF1. Cancer Cell 2010, 17: 98110. 10.1016/j.ccr.2009.12.020
 21.
Noushmehr H, Weisenberger DJ, Diefes K, Phillips HS, Pujara K, Berman BP, Pan F, Pelloski CE, Sulman EP, Bhat KP, Verhaak RG, Hoadley KA, Hayes DN, Perou CM, Schmidt HK, Ding L, Wilson RK, Van Den Berg D, Shen H, Bengtsson H, Neuvial P, Cope LM, Buckley J, Herman JG, Baylin SB, Laird PW, Aldape K: Identification of a CpG island methylator phenotype that defines a distinct subgroup of glioma. Cancer Cell 2010,17(5):510522. 10.1016/j.ccr.2010.03.017
 22.
Data levels and data types . [TCGA]. Accessed 22 August 2013 https://tcgadata.nci.nih.gov/tcga/tcgaDataType.jsp
 23.
Loilome W, Joshi AD, ap Rhys CM, Piccirillo S, Vescovi AL, Angelo VL, Gallia GL, Riggins GJ: Glioblastoma cell growth is suppressed by disruption of Fibroblast Growth Factor pathway signaling. J. Neurooncol 2009,94(3):359366. 10.1007/s1106000998855
 24.
Katoh M, Nakagama H: FGF Receptors: Cancer Biology and Therapeutics. Rev. Med. Res 2013. doi:10.1002/med.21288
 25.
Goldstein M, Meller I, OrrUrtreger A: FGFR1 overexpression in primary rhabdomyosarcoma tumors is associated with hypomethylation of a 5’ CpG island and abnormal expression of the AKT1, NOG, and BMP4 genes. Genes Chromosomes Cancer 2007,46(11):10281038. 10.1002/gcc.20489
 26.
Carapancea M, Alexandru O, Fetea AS, Dragutescu L, Castro J, Georgescu A, PopaWagner A, Backlund ML, Lewensohn R, Dricu A: Growth factor receptors signaling in glioblastoma cells: therapeutic implications. J. Neurooncol 2009,92(2):137147. 10.1007/s1106000897538
 27.
Chakravarti A, Loeffler JS, Dyson NJ: Insulinlike growth factor receptor I mediates resistance to antiepidermal growth factor receptor therapy in primary human glioblastoma cells through continued activation of phosphoinositide 3kinase signaling. Cancer Res 2002, 62: 200207.
 28.
Hewish M, Chau I, Cunningham D: Insulinlike growth factor 1 receptor targeted therapeutics: novel compounds and novel treatment strategies for cancer medicine. Recent Pat. Anticancer Drug Discov 2009, 4: 5472. 10.2174/157489209787002515
 29.
Ruano Y, Mollejo M, Ribalta T, Fiano C, Camacho FI, Gomez E, de Lope AR, HernandezMoneo JL, Martinez P, Melendez B: Identification of novel candidate target genes in amplicons of Glioblastoma multiforme tumors detected by expression and CGH microarray profiling. Mol. Cancer 2006, 5: 39.
 30.
Yin D, Ogawa S, Kawamata N, Tunici P, Finocchiaro G, Eoli M, Ruckert C, Huynh T, Liu G, Kato M, Sanada M, Jauch A, Dugas M, Black KL, Koeffler HP: Highresolution genomic copy number profiling of glioblastoma multiforme by single nucleotide polymorphism DNA microarray. Mol. Cancer Res 2009,7(5):665677. 10.1158/15417786.MCR080270
 31.
Rebocho AP, Marais R: ARAF acts as a scaffold to stabilize BRAF: CRAF heterodimers. Oncogene 2013,32(26):32073212. 10.1038/onc.2012.330
 32.
Craig DW, O’Shaughnessy JA, Kiefer JA, Aldrich J, Sinari S, Moses TM, Wong S, Dinh J, Christoforides A, Blum JL, Aitelli CL, Osborne CR, Izatt T, Kurdoglu A, Baker A, Koeman J, Barbacioru C, Sakarya O, De La Vega FM, Siddiqui A, Hoang L, Billings PR, Salhia B, Tolcher AW, Trent JM, Mousses S, Von Hoff D, Carpten JD: Genome and transcriptome sequencing in prospective metastatic triplenegative breast cancer uncovers therapeutic vulnerabilities. Mol. Cancer Ther 2013, 12: 104116.
 33.
Lowenstein EJ, Daly RJ, Batzer AG, Li W, Margolis B, Lammers R, Ullrich A, Skolnik EY, BarSagi D, Schlessinger J: The SH2 and SH3 domaincontaining protein GRB2 links receptor tyrosine kinases to ras signaling. Cell 1992,70(3):431442. 10.1016/00928674(92)90167B
 34.
Kapoor GS, O’Rourke DM: SIRPalpha1 receptors interfere with the EGFRvIII signalosome to inhibit glioblastoma cell transformation and migration. Oncogene 2010,29(29):41304144. 10.1038/onc.2010.164
 35.
Prigent SA, Nagane M, Lin H, Huvar I, Boss GR, Feramisco JR, Cavenee WK, Huang HS: Enhanced tumorigenic behavior of glioblastoma cells expressing a truncated epidermal growth factor receptor is mediated through the RasShcGrb2 pathway. J. Biol. Chem 1996,271(41):2563925645. 10.1074/jbc.271.41.25639
 36.
Solomon DA, Kim JS, Jenkins S, Ressom H, Huang M, Coppa N, Mabanta L, Bigner D, Yan H, Jean W, Waldman T: Identification of p18 INK4c as a tumor suppressor gene in glioblastoma multiforme. Cancer Res 2008,68(8):25642569. 10.1158/00085472.CAN076388
 37.
Nazarenko I, Hede SM, He X, Hedren A, Thompson J, Lindstrom MS, Nister M: PDGF and PDGF receptors in glioma. Ups. J. Med. Sci 2012,117(2):99112. 10.3109/03009734.2012.665097
 38.
Suzuki K, Momota H, Tonooka A, Noguchi H, Yamamoto K, Wanibuchi M, Minamida Y, Hasegawa T, Houkin K: Glioblastoma simultaneously present with adjacent meningioma: case report and review of the literature. J. Neurooncol 2010, 99: 147153. 10.1007/s1106000901099
 39.
Jiang Y, Boije M, Westermark B, Uhrbom L: PDGFB Can sustain selfrenewal and tumorigenicity of experimental gliomaderived cancerinitiating cells by preventing oligodendrocyte differentiation. Neoplasia 2011,13(6):492503.
 40.
Cooper LA, Gutman DA, Long Q, Johnson BA, Cholleti SR, Kurc T, Saltz JH, Brat DJ, Moreno CS: The proneural molecular signature is enriched in oligodendrogliomas and predicts improved survival among diffuse gliomas. PLoS ONE 2010,5(9):e12548. 10.1371/journal.pone.0012548
 41.
Brennan C, Momota H, Hambardzumyan D, Ozawa T, Tandon A, Pedraza A, Holland E: Glioblastoma subclasses can be defined by activity among signal transduction pathways and associated genomic alterations. PLoS ONE 2009,4(11):e7752. 10.1371/journal.pone.0007752
Acknowledgements
VB and JSM’s research was partially supported by NIH grant R01 CA160736 and the Cancer Center Support Grant (CCSG) (P30 CA016672). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Cancer Institute or the National Institutes of Health.
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declared that they have no competing interests.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
About this article
Cite this article
Jennings, E.M., Morris, J.S., Carroll, R.J. et al. Bayesian methods for expressionbased integration of various types of genomics data. J Bioinform Sys Biology 2013, 13 (2013). https://doi.org/10.1186/16874153201313
Received:
Accepted:
Published:
Keywords
 Bayesian modeling
 Genomics
 Hierarchical models
 Integrative analysis
 Shrinkage priors