BCB420 - Computational Systems Biology

class: center, middle, inverse, title-slide

# BCB420 - Computational Systems Biology
## Lecture 5 - Differential Expression
### Ruth Isserlin
### 2020-02-04

---

## Before we start

## Assignment #1 
  * <font size=5> Due Today! @ 20:00 </font>

## What to hand in?
  * **html rendered RNotebook** - you should be able to submit this through quercus
  * Make sure the notebook and all associated code is checked into your github repo as I will be pulling all the repos at the deadline and using them to compile your code. - Your checked in code must replicate the handed in notebook.
  * **Do not check the data file into your repo!** - your code should download the data from GEO and generate a new, cleaned data file.
  * Document your work and your code directly in the notebook.
  * **Read the paper associated with your data!**
  * You are allowed to use helper functions or methods but make sure when you source those files the paths to them are relative and that they are checked into your repo as well. 
  
---
# Differential Gene Expression Analysis

## Where we left off from last week
  * data from "Apoptosis enhancing drugs overcome innate platinum resistance in CA125 negative tumor initiating populations of high grade serous ovarian cancer"
  * 10 ovarian tumours sorted by CA125+ve and -ve antibody
  * we normalized it, we cleaned it, we made sure we had up to date identifers from ensembl.
  * What's next?
  
---

First things first, 
  * Load the data

```r
normalized_count_data <- read.table(file=file.path("data", "GSE70072_finalized_normalized_counts.txt"),
                                    header = TRUE,sep = "\t",
                                    stringsAsFactors = FALSE,
                                    check.names=FALSE)
```

---

* Take a look at the data we just loaded.

```r
kable(normalized_count_data[1:5,1:5], type="html")
```

<table>
 <thead>
  <tr>
   <th style="text-align:left;"> ensembl_gene_id </th>
   <th style="text-align:left;"> hgnc_symbol </th>
   <th style="text-align:right;"> Pt.A.CA125- </th>
   <th style="text-align:right;"> Pt.A.CA125+ </th>
   <th style="text-align:right;"> pt.B.CA125- </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:left;"> ENSG00000000003 </td>
   <td style="text-align:left;"> TSPAN6 </td>
   <td style="text-align:right;"> 6.945591 </td>
   <td style="text-align:right;"> 6.6488678 </td>
   <td style="text-align:right;"> 7.1585772 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000000419 </td>
   <td style="text-align:left;"> DPM1 </td>
   <td style="text-align:right;"> 5.912242 </td>
   <td style="text-align:right;"> 6.0789211 </td>
   <td style="text-align:right;"> 5.3233556 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000000457 </td>
   <td style="text-align:left;"> SCYL3 </td>
   <td style="text-align:right;"> 4.046979 </td>
   <td style="text-align:right;"> 3.2375251 </td>
   <td style="text-align:right;"> 4.2441139 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000000460 </td>
   <td style="text-align:left;"> C1orf112 </td>
   <td style="text-align:right;"> 3.927282 </td>
   <td style="text-align:right;"> 3.6138063 </td>
   <td style="text-align:right;"> 4.1747420 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000000938 </td>
   <td style="text-align:left;"> FGR </td>
   <td style="text-align:right;"> 0.000000 </td>
   <td style="text-align:right;"> 0.8434171 </td>
   <td style="text-align:right;"> 0.4502989 </td>
  </tr>
</tbody>
</table>

---

Create a numerical matrix that we can create a heatmap from

```r
heatmap_matrix <- normalized_count_data[,3:ncol(normalized_count_data)]
rownames(heatmap_matrix) <- normalized_count_data$ensembl_gene_id
colnames(heatmap_matrix) <- colnames(normalized_count_data[,3:ncol(normalized_count_data)])
```

---

### Create a Heatmap

What is a heatmap?
  * data graph that translates numbers into a colour scale over many samples and measurements.
  * Has multiple additional methods that we can use to restructure the format to highlight themes in the data.

```r
library(ComplexHeatmap)
library(circlize)

if(min(heatmap_matrix) == 0){
    heatmap_col = colorRamp2(c( 0, max(heatmap_matrix)), c( "white", "red"))
  } else {
    heatmap_col = colorRamp2(c(min(heatmap_matrix), 0, max(heatmap_matrix)), c("blue", "white", "red"))
  }

current_heatmap <- Heatmap(as.matrix(heatmap_matrix),
                               show_row_dend = TRUE,
                               show_column_dend = TRUE, 
                               col=heatmap_col,
                               show_column_names = TRUE, 
                               show_row_names = FALSE,
                               show_heatmap_legend = TRUE
                               )
```

---

```r
current_heatmap
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-6-1.png)
---
Let's try that again using Row - normalization
  * scale each row and centre them around the mean.
  * From each value we subtract the mean and divide by the standard deviation of the row to row normalize it.
  * some other heatmap packages might have row normalization built in.

```r
*heatmap_matrix <- t(scale(t(heatmap_matrix)))

---

```r
current_heatmap
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-8-1.png)

---
Traditionally, low scale experiments are designed to compare the expression of a single gene or maybe an handful of genes.

```r
ca125_pos_samples <- grep(colnames(normalized_count_data),
                          pattern="\\+")
ca125_neg_samples <- grep(colnames(normalized_count_data),
                          pattern="\\-")

gene_of_interest <- which(normalized_count_data$hgnc_symbol == "MUC16")
```

---

.pull-left[

```r
muc16_neg_samples <- t(normalized_count_data
                       [gene_of_interest,
                         ca125_neg_samples])
colnames(muc16_neg_samples) <- c("neg_samples")
muc16_neg_samples 
```

```
##             neg_samples
## Pt.A.CA125-   10.723796
## pt.B.CA125-    8.850579
## Pt.C.CA125-    9.153117
## pt.D.CA125-    9.013810
## pt.E.CA125-    7.072799
## pt.F.CA125-    7.666300
## pt.G.CA125-    8.847846
## pt.H.CA125-    9.392200
## pt.I.CA125-    7.536275
## pt.J.CA125-    6.190249
```
]

.pull-right[

```r
muc16_pos_samples <- t(normalized_count_data
                       [gene_of_interest,
                         ca125_pos_samples])
colnames(muc16_pos_samples) <- c("pos_samples")
muc16_pos_samples
```

```
##             pos_samples
## Pt.A.CA125+    9.909214
## pt.B.CA125+    8.587325
## pt.C.CA125+    8.340244
## pt.D.CA125+    8.710818
## pt.E.CA125+    7.085022
## pt.F.CA125+    7.861518
## pt.G.CA125+    8.140352
## pt.H.CA125+    8.884911
## pt.I.CA125+    7.785848
## pt.J.CA125+    5.596313
```
]

---

### Is MUC16 differentially expressed in our samples?

* Using a simple t.test compare this individual gene. 
* The null hypothesis of the two sample t-test is that there is **no** difference in means of each sample
* It assumes that both sample A and sample B are normally distributed.

```r
t.test(x=t(muc16_pos_samples),y=t(muc16_neg_samples))
```

```
## 
## 	Welch Two Sample t-test
## 
## data:  t(muc16_pos_samples) and t(muc16_neg_samples)
## t = -0.63961, df = 17.695, p-value = 0.5306
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
##  -1.5205410  0.8114598
## sample estimates:
## mean of x mean of y 
##  8.090156  8.444697
```

---

.pull-left[

```r
muc16_neg_samples <- t(normalized_count_data[gene_of_interest,ca125_neg_samples])
colnames(muc16_neg_samples) <- c("neg_samples")
muc16_neg_samples 
```

.pull-right[

```r
muc16_pos_samples <- t(normalized_count_data[gene_of_interest,ca125_pos_samples])
colnames(muc16_pos_samples) <- c("pos_samples")
muc16_pos_samples
```

???
Obviously it is hard to tell just by looking at the data if the gene is differentially expreseed but there are a lot variables that could explain some of the differences between the samples that are not accounted for in this traditional naive approach.

---

###How can we account for these variables?
* There are many different packages that try and control for these variables.  We are going to go through two of them:
  * [Limma](https://bioconductor.org/packages/release/bioc/html/limma.html) - LInear Models of MircroArray
    * orginallay published in [2004](https://www.ncbi.nlm.nih.gov/pubmed/16646809) for use with microarrays
    * updated and improved over the years to also include rnaseq data.
  * [edgeR](https://bioconductor.org/packages/release/bioc/html/edgeR.html) 
    * Suite of methods specialized for Bulk RNAseq analysis
    * contains multiple methods to compute differential expression including a similar general linear method to the limma package.
  
---

## Limma
  * LInear Models of MircroArray
  * The premise of the limma approach is the use of linear models to define differential expression.
  * **Linear Models** - "describe a continuous response variable as a function of one or more predictor variables."^1
  * Linear regression involves finding an linear model to explain the data.  Often described as fitting a line to a set of data points.
  * for our example, we have a set of measurements and we want to figure out the function that best describes it.
  * Using empirical bayes to compute the odds of any gene being differentially expressed given its contrasts.
  
<font size=2>[1]https://www.mathworks.com/discovery/linear-model.html</font>

---

If you remember from last week we used an MDSPlot to look at how our samples are clustering.  We used the plotMDS from the edgeR package but we can just as easily use the plotMDS function from the the limma package.

```r
limma::plotMDS(heatmap_matrix,
*              col = rep(c("darkgreen","blue"),10))
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-15-1.png)

---
Another way to look at the exact same plot is to color by patient

```r
pat_colors <- rainbow(10)
pat_colors <- unlist(lapply(pat_colors,FUN=function(x){rep(x,2)}))

limma::plotMDS(heatmap_matrix,
*              col = pat_colors )
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-16-1.png)

---

## Model
Define the groups
  * From the above plot we know that which samples/patient the data comes from is important to determining its value.
  * We also have hypothesized that CA125 status will also contribute to the differential.

```r
#get the 2 and third token from the column names
samples <- data.frame(
        lapply(colnames(normalized_count_data)[3:22], 
        FUN=function(x){
          unlist(strsplit(x, split = "\\."))[c(2,3)]}))
colnames(samples) <- colnames(normalized_count_data)[3:22]
rownames(samples) <- c("patients","cell_type")
samples <- data.frame(t(samples))
```

```r
samples[1:5,]
```

```
##             patients cell_type
## Pt.A.CA125-        A    CA125-
## Pt.A.CA125+        A    CA125+
## pt.B.CA125-        B    CA125-
## pt.B.CA125+        B    CA125+
## Pt.C.CA125-        C    CA125-
```

---
### Model - cont'd

* function to create a linear model in R - model.matrix
* creates a design matrix

```r
model_design <- model.matrix(~ samples$cell_type)
kable(model_design, type="html")
```

<table>
 <thead>
  <tr>
   <th style="text-align:right;"> (Intercept) </th>
   <th style="text-align:right;"> samples$cell_typeCA125+ </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
</tbody>
</table>

---

Create our data matrix 
  * similar to what we used last week when we were using the edgeR package but slightly different

```r
expressionMatrix <- as.matrix(normalized_count_data[,3:22])
rownames(expressionMatrix) <- normalized_count_data$ensembl_gene_id
colnames(expressionMatrix) <- colnames(normalized_count_data)[3:22]
minimalSet <- ExpressionSet(assayData=expressionMatrix)
```

Fit our data to the above model

```r
fit <- lmFit(minimalSet, model_design)
```

---

Apply empircal Bayes to compute differential expression for the above described model.
  * The parameter trend=TRUE is specific to RNA-seq data.  (exclude for microarray data)

```r
fit2 <- eBayes(fit,trend=TRUE)
```

```r
topfit <- topTable(fit2, 
                   coef=ncol(model_design),
                   adjust.method = "BH",
                   number = nrow(expressionMatrix))

#merge hgnc names to topfit table
output_hits <- merge(normalized_count_data[,1:2],
                     topfit,
                     by.y=0,by.x=1,
                     all.y=TRUE)

#sort by pvalue
output_hits <- output_hits[order(output_hits$P.Value),]
```

---

```r
kable(output_hits[1:10,],type="html")
```

<table>
 <thead>
  <tr>
   <th style="text-align:left;">   </th>
   <th style="text-align:left;"> ensembl_gene_id </th>
   <th style="text-align:left;"> hgnc_symbol </th>
   <th style="text-align:right;"> logFC </th>
   <th style="text-align:right;"> AveExpr </th>
   <th style="text-align:right;"> t </th>
   <th style="text-align:right;"> P.Value </th>
   <th style="text-align:right;"> adj.P.Val </th>
   <th style="text-align:right;"> B </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:left;"> 7460 </td>
   <td style="text-align:left;"> ENSG00000144824 </td>
   <td style="text-align:left;"> PHLDB2 </td>
   <td style="text-align:right;"> 1.2098391 </td>
   <td style="text-align:right;"> 3.5114343 </td>
   <td style="text-align:right;"> 2.860563 </td>
   <td style="text-align:right;"> 0.0089748 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.319488 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 5910 </td>
   <td style="text-align:left;"> ENSG00000134013 </td>
   <td style="text-align:left;"> LOXL2 </td>
   <td style="text-align:right;"> 1.2123611 </td>
   <td style="text-align:right;"> 2.7201330 </td>
   <td style="text-align:right;"> 2.703285 </td>
   <td style="text-align:right;"> 0.0128421 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.346509 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 7076 </td>
   <td style="text-align:left;"> ENSG00000141753 </td>
   <td style="text-align:left;"> IGFBP4 </td>
   <td style="text-align:right;"> 1.3157584 </td>
   <td style="text-align:right;"> 4.7001042 </td>
   <td style="text-align:right;"> 2.650939 </td>
   <td style="text-align:right;"> 0.0144467 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.355489 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 2481 </td>
   <td style="text-align:left;"> ENSG00000103241 </td>
   <td style="text-align:left;"> FOXF1 </td>
   <td style="text-align:right;"> 0.8909267 </td>
   <td style="text-align:right;"> 0.5938013 </td>
   <td style="text-align:right;"> 2.624033 </td>
   <td style="text-align:right;"> 0.0153431 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.360099 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 5248 </td>
   <td style="text-align:left;"> ENSG00000128578 </td>
   <td style="text-align:left;"> STRIP2 </td>
   <td style="text-align:right;"> 0.5782501 </td>
   <td style="text-align:right;"> 1.6851401 </td>
   <td style="text-align:right;"> 2.623044 </td>
   <td style="text-align:right;"> 0.0153770 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.360268 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 5657 </td>
   <td style="text-align:left;"> ENSG00000132031 </td>
   <td style="text-align:left;"> MATN3 </td>
   <td style="text-align:right;"> 0.7304186 </td>
   <td style="text-align:right;"> 0.5863327 </td>
   <td style="text-align:right;"> 2.620737 </td>
   <td style="text-align:right;"> 0.0154564 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.360663 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 13151 </td>
   <td style="text-align:left;"> ENSG00000187479 </td>
   <td style="text-align:left;"> C11orf96 </td>
   <td style="text-align:right;"> 1.5050456 </td>
   <td style="text-align:right;"> 1.6884847 </td>
   <td style="text-align:right;"> 2.592236 </td>
   <td style="text-align:right;"> 0.0164698 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.365541 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 7458 </td>
   <td style="text-align:left;"> ENSG00000144810 </td>
   <td style="text-align:left;"> COL8A1 </td>
   <td style="text-align:right;"> 1.5478954 </td>
   <td style="text-align:right;"> 4.5217668 </td>
   <td style="text-align:right;"> 2.591839 </td>
   <td style="text-align:right;"> 0.0164843 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.365608 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 4132 </td>
   <td style="text-align:left;"> ENSG00000117152 </td>
   <td style="text-align:left;"> RGS4 </td>
   <td style="text-align:right;"> 1.6802024 </td>
   <td style="text-align:right;"> 2.8692665 </td>
   <td style="text-align:right;"> 2.585316 </td>
   <td style="text-align:right;"> 0.0167250 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.366724 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 18391 </td>
   <td style="text-align:left;"> ENSG00000261335 </td>
   <td style="text-align:left;">  </td>
   <td style="text-align:right;"> -0.4209006 </td>
   <td style="text-align:right;"> 0.4253192 </td>
   <td style="text-align:right;"> -2.556786 </td>
   <td style="text-align:right;"> 0.0178171 </td>
   <td style="text-align:right;"> 0.9999766 </td>
   <td style="text-align:right;"> -4.371599 </td>
  </tr>
</tbody>
</table>

---
How many gene pass the threshold p-value < 0.05?

```r
length(which(output_hits$P.Value < 0.05))
```

```
## [1] 87
```

How many genes pass correction?
--

```r
length(which(output_hits$adj.P.Val < 0.05))
```

```
## [1] 0
```
---
## Correction?
  * Referring to multipole hypothesis testing.  As the number of tests performed increases the liklihood that a positive results will occur simply by chance increases.  We need to control for this
  * Multiple hypothesis testing will come up for differential expression, pathways analysis and for any analysis where there are multiple tests being performed
  * Control for family-wise error rate or for false discovery rate
  * There are a range of different methods to correct for this:
    1. Bonferonni - considered to be overly stringent by many.  p-values are multiplied by the number of comparisons
    1. Benjamni - hochberg
    1. Benjamini - Yekutieli

```r
p.adjust.methods
```

```
## [1] "holm"       "hochberg"   "hommel"     "bonferroni" "BH"        
## [6] "BY"         "fdr"        "none"
```

---
Can we improve our results if we account for the patient variability?

### Model - cont'd

* function to create a linear model in R - model.matrix
* creates a design matrix

```r
model_design_pat <- model.matrix(
  ~ samples$patients + samples$cell_type)
kable(model_design_pat,type="html")
```

<table>
 <thead>
  <tr>
   <th style="text-align:right;"> (Intercept) </th>
   <th style="text-align:right;"> samples$patientsB </th>
   <th style="text-align:right;"> samples$patientsC </th>
   <th style="text-align:right;"> samples$patientsD </th>
   <th style="text-align:right;"> samples$patientsE </th>
   <th style="text-align:right;"> samples$patientsF </th>
   <th style="text-align:right;"> samples$patientsG </th>
   <th style="text-align:right;"> samples$patientsH </th>
   <th style="text-align:right;"> samples$patientsI </th>
   <th style="text-align:right;"> samples$patientsJ </th>
   <th style="text-align:right;"> samples$cell_typeCA125+ </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
</tbody>
</table>

---
Fit our data to the above model

```r
fit_pat <- lmFit(minimalSet, model_design_pat)
```

---

Apply empircal Bayes to compute differential expression for the above described model.
  * The parameter trend=TRUE is specific to RNA-seq data.  (exclude for microarray data)

```r
fit2_pat <- eBayes(fit_pat,trend=TRUE)
```

```r
topfit_pat <- topTable(fit2_pat, 
                   coef=ncol(model_design_pat),
                   adjust.method = "BH",
                   number = nrow(expressionMatrix))

#merge hgnc names to topfit table
output_hits_pat <- merge(normalized_count_data[,1:2],
                         topfit_pat,by.y=0,by.x=1,all.y=TRUE)

#sort by pvalue
output_hits_pat <- output_hits_pat[order(output_hits_pat$P.Value),]
```

---

```r
kable(output_hits_pat[1:10,],type="html")
```

<table>
 <thead>
  <tr>
   <th style="text-align:left;">   </th>
   <th style="text-align:left;"> ensembl_gene_id </th>
   <th style="text-align:left;"> hgnc_symbol </th>
   <th style="text-align:right;"> logFC </th>
   <th style="text-align:right;"> AveExpr </th>
   <th style="text-align:right;"> t </th>
   <th style="text-align:right;"> P.Value </th>
   <th style="text-align:right;"> adj.P.Val </th>
   <th style="text-align:right;"> B </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:left;"> 12450 </td>
   <td style="text-align:left;"> ENSG00000182752 </td>
   <td style="text-align:left;"> PAPPA </td>
   <td style="text-align:right;"> 1.2179144 </td>
   <td style="text-align:right;"> 1.681068 </td>
   <td style="text-align:right;"> 5.419384 </td>
   <td style="text-align:right;"> 0.0000782 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> 0.7555086 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 415 </td>
   <td style="text-align:left;"> ENSG00000026508 </td>
   <td style="text-align:left;"> CD44 </td>
   <td style="text-align:right;"> 1.1072045 </td>
   <td style="text-align:right;"> 7.848369 </td>
   <td style="text-align:right;"> 5.198156 </td>
   <td style="text-align:right;"> 0.0001182 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> 0.4934018 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 2402 </td>
   <td style="text-align:left;"> ENSG00000102755 </td>
   <td style="text-align:left;"> FLT1 </td>
   <td style="text-align:right;"> 0.7659613 </td>
   <td style="text-align:right;"> 1.645930 </td>
   <td style="text-align:right;"> 4.849620 </td>
   <td style="text-align:right;"> 0.0002293 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> 0.0622643 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 5117 </td>
   <td style="text-align:left;"> ENSG00000126878 </td>
   <td style="text-align:left;"> AIF1L </td>
   <td style="text-align:right;"> -0.6347014 </td>
   <td style="text-align:right;"> 6.355584 </td>
   <td style="text-align:right;"> -4.795010 </td>
   <td style="text-align:right;"> 0.0002547 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> -0.0072677 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 1506 </td>
   <td style="text-align:left;"> ENSG00000085552 </td>
   <td style="text-align:left;"> IGSF9 </td>
   <td style="text-align:right;"> -0.7312699 </td>
   <td style="text-align:right;"> 2.432940 </td>
   <td style="text-align:right;"> -4.786149 </td>
   <td style="text-align:right;"> 0.0002591 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> -0.0186000 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 12397 </td>
   <td style="text-align:left;"> ENSG00000182326 </td>
   <td style="text-align:left;"> C1S </td>
   <td style="text-align:right;"> 0.9220917 </td>
   <td style="text-align:right;"> 7.579617 </td>
   <td style="text-align:right;"> 4.745380 </td>
   <td style="text-align:right;"> 0.0002803 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> -0.0709155 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 8036 </td>
   <td style="text-align:left;"> ENSG00000150938 </td>
   <td style="text-align:left;"> CRIM1 </td>
   <td style="text-align:right;"> 0.6230945 </td>
   <td style="text-align:right;"> 5.673619 </td>
   <td style="text-align:right;"> 4.741666 </td>
   <td style="text-align:right;"> 0.0002823 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> -0.0756950 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 13268 </td>
   <td style="text-align:left;"> ENSG00000188295 </td>
   <td style="text-align:left;"> ZNF669 </td>
   <td style="text-align:right;"> -0.7028924 </td>
   <td style="text-align:right;"> 3.272620 </td>
   <td style="text-align:right;"> -4.724103 </td>
   <td style="text-align:right;"> 0.0002921 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> -0.0983332 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 13314 </td>
   <td style="text-align:left;"> ENSG00000188641 </td>
   <td style="text-align:left;"> DPYD </td>
   <td style="text-align:right;"> 0.8558769 </td>
   <td style="text-align:right;"> 3.122403 </td>
   <td style="text-align:right;"> 4.549019 </td>
   <td style="text-align:right;"> 0.0004107 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> -0.3269100 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> 19113 </td>
   <td style="text-align:left;"> ENSG00000272796 </td>
   <td style="text-align:left;"> RP1-74M1.3 </td>
   <td style="text-align:right;"> -0.6786633 </td>
   <td style="text-align:right;"> 1.269677 </td>
   <td style="text-align:right;"> -4.539777 </td>
   <td style="text-align:right;"> 0.0004182 </td>
   <td style="text-align:right;"> 0.4420918 </td>
   <td style="text-align:right;"> -0.3391209 </td>
  </tr>
</tbody>
</table>

---

How many gene pass the threshold p-value < 0.05?

```r
length(which(output_hits_pat$P.Value < 0.05))
```

```
## [1] 1713
```

How many genes pass correction?
--

```r
length(which(output_hits_pat$adj.P.Val < 0.05))
```

```
## [1] 0
```

---

Compare the results from the two different models

```r
simple_model_pvalues <- data.frame(ensembl_id = output_hits$ensembl_gene_id,
                                   simple_pvalue=output_hits$P.Value)
pat_model_pvalues <-  data.frame(ensembl_id = output_hits_pat$ensembl_gene_id,
                                 patient_pvalue = output_hits_pat$P.Value)
two_models_pvalues <- merge(simple_model_pvalues,
                            pat_model_pvalues,by.x=1,by.y=1)

two_models_pvalues$colour <- "black"
two_models_pvalues$colour[two_models_pvalues$simple_pvalue<0.05] <- "orange"
two_models_pvalues$colour[two_models_pvalues$patient_pvalue<0.05] <- "blue"
two_models_pvalues$colour[two_models_pvalues$simple_pvalue<0.05 & two_models_pvalues$patient_pvalue<0.05] <- "red"
```

```r
plot(two_models_pvalues$simple_pvalue,two_models_pvalues$patient_pvalue,
     col = two_models_pvalues$colour,
     xlab = "simple model p-values",
     ylab ="Patient model p-values", 
     main="Simple vs Patient Limma")
```

---

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-37-1.png)

---

```r
ensembl_of_interest <- normalized_count_data$ensembl_gene_id[
  which(normalized_count_data$hgnc_symbol == "MUC16")]

two_models_pvalues$colour <- "grey"
two_models_pvalues$colour[two_models_pvalues$ensembl_id==ensembl_of_interest] <- "red"

plot(two_models_pvalues$simple_pvalue,two_models_pvalues$patient_pvalue,
     col = two_models_pvalues$colour,
     xlab = "simple model p-values",
     ylab ="Patient model p-values",
      main="Simple vs Patient Limma")
```

---
![](lecture5_differential_expression_files/figure-html/unnamed-chunk-39-1.png)

---
let's come back to the initial heatmap representation of the data

```r
top_hits <- output_hits_pat$ensembl_gene_id[output_hits_pat$P.Value<0.05]
heatmap_matrix_tophits <- t(
  scale(t(heatmap_matrix[
*   which(rownames(heatmap_matrix) %in% top_hits),])))

if(min(heatmap_matrix_tophits) == 0){
    heatmap_col = colorRamp2(c( 0, max(heatmap_matrix_tophits)), 
                             c( "white", "red"))
  } else {
    heatmap_col = colorRamp2(c(min(heatmap_matrix_tophits), 0, max(heatmap_matrix_tophits)), c("blue", "white", "red"))
  }

current_heatmap <- Heatmap(as.matrix(heatmap_matrix_tophits),
                           cluster_rows = TRUE,
                           cluster_columns = TRUE,
                               show_row_dend = TRUE,
                               show_column_dend = TRUE, 
                               col=heatmap_col,
                               show_column_names = TRUE, 
                               show_row_names = FALSE,
                               show_heatmap_legend = TRUE,
                               )
```

???
scale is a generic function that centres of scales the columns of a numeric matrix

---
Heatmap of top hits using Limma (accounting for patient variability) - 
  * p-value < 0.05

```r
current_heatmap
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-41-1.png)

---

```r
heatmap_matrix_tophits<- heatmap_matrix_tophits[, 
                     c(                    
                     grep(colnames(heatmap_matrix_tophits),pattern = "\\+"),                            grep(colnames(heatmap_matrix_tophits),pattern = "\\-")
                      )]

current_heatmap <- Heatmap(as.matrix(heatmap_matrix_tophits),
                           cluster_rows = TRUE,
*                          cluster_columns = FALSE,
                               show_row_dend = TRUE,
                               show_column_dend = TRUE, 
                               col=heatmap_col,
                               show_column_names = TRUE, 
                               show_row_names = FALSE,
                               show_heatmap_legend = TRUE,
                               )
```

---

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-43-1.png)

???
As we saw from the MDS plot the separation between my samples is not great.  We can try and correct for that but unfortunately, there is only so much that will help.

---
Try for a slightly cleaner picture.

```r
*top_hits <- output_hits_pat$ensembl_gene_id[output_hits_pat$P.Value<0.01]
heatmap_matrix_tophits <- t(
  scale(t(heatmap_matrix[which(rownames(heatmap_matrix) %in% top_hits),])))

heatmap_matrix_tophits<- heatmap_matrix_tophits[,
       c(grep(colnames(heatmap_matrix_tophits),pattern = "\\+"),                            grep(colnames(heatmap_matrix_tophits),pattern = "\\-"))]

current_heatmap <- Heatmap(as.matrix(heatmap_matrix_tophits),
                  cluster_rows = TRUE,  show_row_dend = TRUE,
*                 cluster_columns = FALSE,show_column_dend = FALSE,
                  col=heatmap_col,show_column_names = TRUE, 
                  show_row_names = FALSE,show_heatmap_legend = TRUE)
```

---
Heatmap of top hits using Limma (accounting for patient variability) - 
  * p-value < 0.05
  * Columns ordered by cell type.
![](lecture5_differential_expression_files/figure-html/unnamed-chunk-45-1.png)

---

### EdgeR
  * Analysis package designed for the processing of RNASeq data.
  * Interestingly, the Limma guide direct users to use edgeR up to the point of calculating differential expression.
  * And limma and edgeR are all written by the same people though...
  * There are many different models available in edgeR that can be used for differential expression.
    * exactTest - used for models that only have one factor
    * Quasi liklihood - used for more complicated models and is highly recommended for bulk RNASeq experiments. (glmQLFTest)
    * liklihood ratio test - can be useful for some experiments with limit number of samples or single sample RNA Seq.. (glmLRTest)
    
---

Review from last class: Set up our edgeR objects

```r
d = DGEList(counts=filtered_data_matrix, group=samples$cell_type)
```

Estimate Dispersion - our model design.

```r
d <- estimateDisp(d, model_design_pat)
```

Fit the model

```r
fit <- glmQLFit(d, model_design_pat)
```

---

```r
kable(model_design_pat[1:10,1:5], type="html") %>%
  row_spec(0, angle = -45)
```

<table>
 <thead>
  <tr>
   <th style="text-align:right;-webkit-transform: rotate(-45deg); -moz-transform: rotate(-45deg); -ms-transform: rotate(-45deg); -o-transform: rotate(-45deg); transform: rotate(-45deg);"> (Intercept) </th>
   <th style="text-align:right;-webkit-transform: rotate(-45deg); -moz-transform: rotate(-45deg); -ms-transform: rotate(-45deg); -o-transform: rotate(-45deg); transform: rotate(-45deg);"> samples$patientsB </th>
   <th style="text-align:right;-webkit-transform: rotate(-45deg); -moz-transform: rotate(-45deg); -ms-transform: rotate(-45deg); -o-transform: rotate(-45deg); transform: rotate(-45deg);"> samples$patientsC </th>
   <th style="text-align:right;-webkit-transform: rotate(-45deg); -moz-transform: rotate(-45deg); -ms-transform: rotate(-45deg); -o-transform: rotate(-45deg); transform: rotate(-45deg);"> samples$patientsD </th>
   <th style="text-align:right;-webkit-transform: rotate(-45deg); -moz-transform: rotate(-45deg); -ms-transform: rotate(-45deg); -o-transform: rotate(-45deg); transform: rotate(-45deg);"> samples$patientsE </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
  <tr>
   <td style="text-align:right;"> 1 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 1 </td>
  </tr>
</tbody>
</table>

---

Calculate differential expression using the Quasi liklihood model

```r
qlf.pos_vs_neg <- glmQLFTest(fit, coef='samples$cell_typeCA125+')
kable(topTags(qlf.pos_vs_neg), type="html")
```

<table>
 <thead>
  <tr>
   <th style="text-align:left;">   </th>
   <th style="text-align:right;"> logFC </th>
   <th style="text-align:right;"> logCPM </th>
   <th style="text-align:right;"> F </th>
   <th style="text-align:right;"> PValue </th>
   <th style="text-align:right;"> FDR </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:left;"> ENSG00000182752 </td>
   <td style="text-align:right;"> 2.2775281 </td>
   <td style="text-align:right;"> 2.7763253 </td>
   <td style="text-align:right;"> 35.42360 </td>
   <td style="text-align:right;"> 0.0000425 </td>
   <td style="text-align:right;"> 0.3654997 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000198804 </td>
   <td style="text-align:right;"> -0.5969046 </td>
   <td style="text-align:right;"> 13.5106123 </td>
   <td style="text-align:right;"> 34.18749 </td>
   <td style="text-align:right;"> 0.0000507 </td>
   <td style="text-align:right;"> 0.3654997 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000240864 </td>
   <td style="text-align:right;"> 5.0704267 </td>
   <td style="text-align:right;"> -0.7698429 </td>
   <td style="text-align:right;"> 55.33012 </td>
   <td style="text-align:right;"> 0.0000571 </td>
   <td style="text-align:right;"> 0.3654997 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000237973 </td>
   <td style="text-align:right;"> -0.5913714 </td>
   <td style="text-align:right;"> 11.7910172 </td>
   <td style="text-align:right;"> 30.98434 </td>
   <td style="text-align:right;"> 0.0000818 </td>
   <td style="text-align:right;"> 0.3705585 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000102755 </td>
   <td style="text-align:right;"> 1.3577028 </td>
   <td style="text-align:right;"> 2.5717883 </td>
   <td style="text-align:right;"> 29.92806 </td>
   <td style="text-align:right;"> 0.0000965 </td>
   <td style="text-align:right;"> 0.3705585 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000198695 </td>
   <td style="text-align:right;"> -0.4370418 </td>
   <td style="text-align:right;"> 8.9070099 </td>
   <td style="text-align:right;"> 26.08487 </td>
   <td style="text-align:right;"> 0.0001832 </td>
   <td style="text-align:right;"> 0.5859799 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000211625 </td>
   <td style="text-align:right;"> 2.9089985 </td>
   <td style="text-align:right;"> 1.8364482 </td>
   <td style="text-align:right;"> 31.99077 </td>
   <td style="text-align:right;"> 0.0002658 </td>
   <td style="text-align:right;"> 0.6229630 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000188641 </td>
   <td style="text-align:right;"> 1.0969060 </td>
   <td style="text-align:right;"> 3.9514876 </td>
   <td style="text-align:right;"> 23.53251 </td>
   <td style="text-align:right;"> 0.0002909 </td>
   <td style="text-align:right;"> 0.6229630 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000249119 </td>
   <td style="text-align:right;"> -0.4797346 </td>
   <td style="text-align:right;"> 6.5308891 </td>
   <td style="text-align:right;"> 23.17139 </td>
   <td style="text-align:right;"> 0.0003114 </td>
   <td style="text-align:right;"> 0.6229630 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000026508 </td>
   <td style="text-align:right;"> 1.0787591 </td>
   <td style="text-align:right;"> 8.4785833 </td>
   <td style="text-align:right;"> 22.56846 </td>
   <td style="text-align:right;"> 0.0003495 </td>
   <td style="text-align:right;"> 0.6229630 </td>
  </tr>
</tbody>
</table>

</td>
   <td>

</td>
   <td>

<table>
 <thead>
  <tr>
   <th style="text-align:left;"> x </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:left;"> samples$cell_typeCA125+ </td>
  </tr>
</tbody>
</table>

</td>
   <td>

</td>
  </tr>
</tbody>
</table>

---

Get all the results

```r
qlf_output_hits <- topTags(qlf.pos_vs_neg,sort.by = "PValue",
                           n = nrow(normalized_count_data))
```

How many gene pass the threshold p-value < 0.05?

```r
length(which(qlf_output_hits$table$PValue < 0.05))
```

```
## [1] 1360
```

How many genes pass correction?
--

```r
length(which(qlf_output_hits$table$FDR < 0.05))
```

```
## [1] 0
```

---
Compare the results from the two different models
  * Limma vs Quasi liklihood

```r
qlf_pat_model_pvalues <- data.frame(
          ensembl_id = rownames(qlf_output_hits$table),
          qlf_patient_pvalue=qlf_output_hits$table$PValue)
limma_pat_model_pvalues <-  data.frame(
          ensembl_id = output_hits_pat$ensembl_gene_id,
          limma_patient_pvalue = output_hits_pat$P.Value)
two_models_pvalues <- merge(qlf_pat_model_pvalues,
                            limma_pat_model_pvalues,
                            by.x=1,by.y=1)

two_models_pvalues$colour <- "black"
two_models_pvalues$colour[two_models_pvalues$qlf_patient_pvalue<0.05] <- "orange"
two_models_pvalues$colour[two_models_pvalues$limma_patient_pvalue<0.05] <- "blue"
two_models_pvalues$colour[two_models_pvalues$qlf_patient_pvalue<0.05 & two_models_pvalues$limma_patient_pvalue<0.05] <- "red"
```

```r
plot(two_models_pvalues$qlf_patient_pvalue,
     two_models_pvalues$limma_patient_pvalue,
     col = two_models_pvalues$colour,
     xlab = "QLF patient model p-values",
     ylab ="Limma Patient model p-values",
     main="QLF vs Limma")
```

---

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-57-1.png)

---

```r
ensembl_of_interest <- normalized_count_data$ensembl_gene_id[
  which(normalized_count_data$hgnc_symbol == "MUC16")]

two_models_pvalues$colour <- "grey"
two_models_pvalues$colour[two_models_pvalues$ensembl_id==ensembl_of_interest] <- "red"

plot(two_models_pvalues$qlf_patient_pvalue,
     two_models_pvalues$limma_patient_pvalue,
     col = two_models_pvalues$colour,
     xlab = "QLF patient model p-values",
     ylab ="Limma Patient model p-values",
     main="QLF vs Limma")

*points(two_models_pvalues[
* two_models_pvalues$ensembl_id==ensembl_of_interest,2:3],
*      pch=24,  col="red", cex=1.5)
```

---
![](lecture5_differential_expression_files/figure-html/unnamed-chunk-59-1.png)

---
let's come back to the initial heatmap representation of the data

```r
*top_hits <- rownames(qlf_output_hits$table)[output_hits_pat$P.Value<0.05]
heatmap_matrix_tophits <- t(
* scale(t(heatmap_matrix[which(rownames(heatmap_matrix) %in% top_hits),])))

???
scale is a generic function that centres of scales the columns of a numeric matrix

---
Heatmap of top hits using the Quasi liklihood model (p-value < 0.05)

```r
current_heatmap
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-61-1.png)

---

Sort the columns by cell type.

```r
top_hits <- rownames(qlf_output_hits$table)[output_hits_pat$P.Value<0.05] 
heatmap_matrix_tophits <- t(
  scale(t(heatmap_matrix[which(rownames(heatmap_matrix) %in% top_hits),])))

heatmap_matrix_tophits<- heatmap_matrix_tophits[,
*      c(grep(colnames(heatmap_matrix_tophits),pattern = "\\+"),                            grep(colnames(heatmap_matrix_tophits),pattern = "\\-"))]

current_heatmap <- Heatmap(as.matrix(heatmap_matrix_tophits),
                           cluster_rows = TRUE,
*                          cluster_columns = FALSE,
                               show_row_dend = TRUE,
*                              show_column_dend = FALSE,
                               col=heatmap_col,
                               show_column_names = TRUE, 
                               show_row_names = FALSE,
                               show_heatmap_legend = TRUE,
                               )
```

---
Heatmap of top hits using the Quasi liklihood model (p-value < 0.05)
  * sort columns according to cell type

```r
current_heatmap
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-63-1.png)

---

## The Cancer Genome Atlas (TCGA)

???
Currently hosted data on the GDC - Genome data commons
Some of the data is open access - data is not traceable to individual patient
Some of the data is restricted and you need to apply to get it
Sequnces - 20,000 cancer samples in depth - RNASeq, Microarray, microRNA, CNV , methylation SNP ...

---
## Get TCGA OV data

```r
library(TCGAbiolinks)
library("SummarizedExperiment")
```

* Get the counts data

```r
query_counts <- GDCquery(project = "TCGA-OV", 
                   data.category = "Transcriptome Profiling",
                   data.type = "Gene Expression Quantification",
                   experimental.strategy = "RNA-Seq",
                   workflow.type = "HTSeq - Counts" ,
*                  legacy = FALSE)
```

```
## --------------------------------------
```

```
## o GDCquery: Searching in GDC database
```

```
## --------------------------------------
```

```
## Genome of reference: hg38
```

```
## --------------------------------------------
```

```
## oo Accessing GDC. This might take a while...
```

```
## --------------------------------------------
```

```
## ooo Project: TCGA-OV
```

```
## --------------------
```

```
## oo Filtering results
```

```
## --------------------
```

```
## ooo By experimental.strategy
```

```
## ooo By data.type
```

```
## ooo By workflow.type
```

```
## ----------------
```

```
## oo Checking data
```

```
## ----------------
```

```
## ooo Check if there are duplicated cases
```

```
## ooo Check if there results for the query
```

```
## -------------------
```

```
## o Preparing output
```

```
## -------------------
```

```r
 GDCdownload(query_counts)
```

```
## Downloading data for project TCGA-OV
```

```
## Of the 379 files for download 379 already exist.
```

```
## All samples have been already downloaded
```

```r
 OVRnaseqSE_counts <- GDCprepare(query_counts)
```

```
## 
|                                                    |  0%                      
|                                                    |0.2638522% ~31 s remaining
|                                                    |0.5277045% ~26 s remaining
|                                                    |0.7915567% ~24 s remaining
|                                                    |1.055409% ~24 s remaining 
|                                                    |1.319261% ~23 s remaining 
|                                                    |1.583113% ~23 s remaining 
|                                                    |1.846966% ~23 s remaining 
|=                                                   |2.110818% ~23 s remaining 
|=                                                   |2.37467% ~23 s remaining  
|=                                                   |2.638522% ~23 s remaining 
|=                                                   |2.902375% ~23 s remaining 
|=                                                   |3.166227% ~22 s remaining 
|=                                                   |3.430079% ~22 s remaining 
|=                                                   |3.693931% ~22 s remaining 
|==                                                  |3.957784% ~22 s remaining 
|==                                                  |4.221636% ~22 s remaining 
|==                                                  |4.485488% ~22 s remaining 
|==                                                  |4.74934% ~22 s remaining  
|==                                                  |5.013193% ~22 s remaining 
|==                                                  |5.277045% ~22 s remaining 
|==                                                  |5.540897% ~21 s remaining 
|===                                                 |5.804749% ~22 s remaining 
|===                                                 |6.068602% ~22 s remaining 
|===                                                 |6.332454% ~22 s remaining 
|===                                                 |6.596306% ~22 s remaining 
|===                                                 |6.860158% ~22 s remaining 
|===                                                 |7.124011% ~22 s remaining 
|===                                                 |7.387863% ~22 s remaining 
|===                                                 |7.651715% ~22 s remaining 
|====                                                |7.915567% ~21 s remaining 
|====                                                |8.17942% ~21 s remaining  
|====                                                |8.443272% ~21 s remaining 
|====                                                |8.707124% ~21 s remaining 
|====                                                |8.970976% ~21 s remaining 
|====                                                |9.234828% ~21 s remaining 
|====                                                |9.498681% ~21 s remaining 
|=====                                               |9.762533% ~21 s remaining 
|=====                                               |10.02639% ~21 s remaining 
|=====                                               |10.29024% ~21 s remaining 
|=====                                               |10.55409% ~21 s remaining 
|=====                                               |10.81794% ~21 s remaining 
|=====                                               |11.08179% ~20 s remaining 
|=====                                               |11.34565% ~21 s remaining 
|======                                              |11.6095% ~21 s remaining  
|======                                              |11.87335% ~21 s remaining 
|======                                              |12.1372% ~20 s remaining  
|======                                              |12.40106% ~20 s remaining 
|======                                              |12.66491% ~20 s remaining 
|======                                              |12.92876% ~20 s remaining 
|======                                              |13.19261% ~20 s remaining 
|======                                              |13.45646% ~20 s remaining 
|=======                                             |13.72032% ~20 s remaining 
|=======                                             |13.98417% ~20 s remaining 
|=======                                             |14.24802% ~20 s remaining 
|=======                                             |14.51187% ~20 s remaining 
|=======                                             |14.77573% ~20 s remaining 
|=======                                             |15.03958% ~20 s remaining 
|=======                                             |15.30343% ~19 s remaining 
|========                                            |15.56728% ~19 s remaining 
|========                                            |15.83113% ~19 s remaining 
|========                                            |16.09499% ~19 s remaining 
|========                                            |16.35884% ~19 s remaining 
|========                                            |16.62269% ~19 s remaining 
|========                                            |16.88654% ~19 s remaining 
|========                                            |17.1504% ~19 s remaining  
|=========                                           |17.41425% ~19 s remaining 
|=========                                           |17.6781% ~19 s remaining  
|=========                                           |17.94195% ~19 s remaining 
|=========                                           |18.2058% ~19 s remaining  
|=========                                           |18.46966% ~19 s remaining 
|=========                                           |18.73351% ~18 s remaining 
|=========                                           |18.99736% ~18 s remaining 
|==========                                          |19.26121% ~18 s remaining 
|==========                                          |19.52507% ~18 s remaining 
|==========                                          |19.78892% ~18 s remaining 
|==========                                          |20.05277% ~18 s remaining 
|==========                                          |20.31662% ~18 s remaining 
|==========                                          |20.58047% ~18 s remaining 
|==========                                          |20.84433% ~18 s remaining 
|==========                                          |21.10818% ~18 s remaining 
|===========                                         |21.37203% ~18 s remaining 
|===========                                         |21.63588% ~18 s remaining 
|===========                                         |21.89974% ~18 s remaining 
|===========                                         |22.16359% ~18 s remaining 
|===========                                         |22.42744% ~18 s remaining 
|===========                                         |22.69129% ~17 s remaining 
|===========                                         |22.95515% ~17 s remaining 
|============                                        |23.219% ~17 s remaining   
|============                                        |23.48285% ~17 s remaining 
|============                                        |23.7467% ~17 s remaining  
|============                                        |24.01055% ~17 s remaining 
|============                                        |24.27441% ~17 s remaining 
|============                                        |24.53826% ~17 s remaining 
|============                                        |24.80211% ~17 s remaining 
|=============                                       |25.06596% ~17 s remaining 
|=============                                       |25.32982% ~17 s remaining 
|=============                                       |25.59367% ~17 s remaining 
|=============                                       |25.85752% ~17 s remaining 
|=============                                       |26.12137% ~17 s remaining 
|=============                                       |26.38522% ~17 s remaining 
|=============                                       |26.64908% ~16 s remaining 
|=============                                       |26.91293% ~16 s remaining 
|==============                                      |27.17678% ~16 s remaining 
|==============                                      |27.44063% ~16 s remaining 
|==============                                      |27.70449% ~16 s remaining 
|==============                                      |27.96834% ~16 s remaining 
|==============                                      |28.23219% ~16 s remaining 
|==============                                      |28.49604% ~16 s remaining 
|==============                                      |28.75989% ~16 s remaining 
|===============                                     |29.02375% ~16 s remaining 
|===============                                     |29.2876% ~16 s remaining  
|===============                                     |29.55145% ~16 s remaining 
|===============                                     |29.8153% ~16 s remaining  
|===============                                     |30.07916% ~16 s remaining 
|===============                                     |30.34301% ~16 s remaining 
|===============                                     |30.60686% ~16 s remaining 
|================                                    |30.87071% ~16 s remaining 
|================                                    |31.13456% ~15 s remaining 
|================                                    |31.39842% ~15 s remaining 
|================                                    |31.66227% ~15 s remaining 
|================                                    |31.92612% ~15 s remaining 
|================                                    |32.18997% ~15 s remaining 
|================                                    |32.45383% ~15 s remaining 
|=================                                   |32.71768% ~15 s remaining 
|=================                                   |32.98153% ~15 s remaining 
|=================                                   |33.24538% ~15 s remaining 
|=================                                   |33.50923% ~15 s remaining 
|=================                                   |33.77309% ~15 s remaining 
|=================                                   |34.03694% ~15 s remaining 
|=================                                   |34.30079% ~15 s remaining 
|=================                                   |34.56464% ~15 s remaining 
|==================                                  |34.8285% ~15 s remaining  
|==================                                  |35.09235% ~15 s remaining 
|==================                                  |35.3562% ~14 s remaining  
|==================                                  |35.62005% ~14 s remaining 
|==================                                  |35.88391% ~14 s remaining 
|==================                                  |36.14776% ~14 s remaining 
|==================                                  |36.41161% ~14 s remaining 
|===================                                 |36.67546% ~14 s remaining 
|===================                                 |36.93931% ~14 s remaining 
|===================                                 |37.20317% ~14 s remaining 
|===================                                 |37.46702% ~14 s remaining 
|===================                                 |37.73087% ~14 s remaining 
|===================                                 |37.99472% ~14 s remaining 
|===================                                 |38.25858% ~14 s remaining 
|====================                                |38.52243% ~14 s remaining 
|====================                                |38.78628% ~14 s remaining 
|====================                                |39.05013% ~14 s remaining 
|====================                                |39.31398% ~14 s remaining 
|====================                                |39.57784% ~14 s remaining 
|====================                                |39.84169% ~14 s remaining 
|====================                                |40.10554% ~14 s remaining 
|====================                                |40.36939% ~14 s remaining 
|=====================                               |40.63325% ~14 s remaining 
|=====================                               |40.8971% ~13 s remaining  
|=====================                               |41.16095% ~13 s remaining 
|=====================                               |41.4248% ~13 s remaining  
|=====================                               |41.68865% ~13 s remaining 
|=====================                               |41.95251% ~13 s remaining 
|=====================                               |42.21636% ~13 s remaining 
|======================                              |42.48021% ~13 s remaining 
|======================                              |42.74406% ~13 s remaining 
|======================                              |43.00792% ~13 s remaining 
|======================                              |43.27177% ~13 s remaining 
|======================                              |43.53562% ~13 s remaining 
|======================                              |43.79947% ~13 s remaining 
|======================                              |44.06332% ~13 s remaining 
|=======================                             |44.32718% ~13 s remaining 
|=======================                             |44.59103% ~13 s remaining 
|=======================                             |44.85488% ~13 s remaining 
|=======================                             |45.11873% ~13 s remaining 
|=======================                             |45.38259% ~13 s remaining 
|=======================                             |45.64644% ~13 s remaining 
|=======================                             |45.91029% ~13 s remaining 
|========================                            |46.17414% ~13 s remaining 
|========================                            |46.43799% ~12 s remaining 
|========================                            |46.70185% ~12 s remaining 
|========================                            |46.9657% ~12 s remaining  
|========================                            |47.22955% ~12 s remaining 
|========================                            |47.4934% ~12 s remaining  
|========================                            |47.75726% ~12 s remaining 
|========================                            |48.02111% ~12 s remaining 
|=========================                           |48.28496% ~12 s remaining 
|=========================                           |48.54881% ~12 s remaining 
|=========================                           |48.81266% ~12 s remaining 
|=========================                           |49.07652% ~12 s remaining 
|=========================                           |49.34037% ~12 s remaining 
|=========================                           |49.60422% ~12 s remaining 
|=========================                           |49.86807% ~12 s remaining 
|==========================                          |50.13193% ~12 s remaining 
|==========================                          |50.39578% ~12 s remaining 
|==========================                          |50.65963% ~11 s remaining 
|==========================                          |50.92348% ~11 s remaining 
|==========================                          |51.18734% ~11 s remaining 
|==========================                          |51.45119% ~11 s remaining 
|==========================                          |51.71504% ~11 s remaining 
|===========================                         |51.97889% ~11 s remaining 
|===========================                         |52.24274% ~11 s remaining 
|===========================                         |52.5066% ~11 s remaining  
|===========================                         |52.77045% ~11 s remaining 
|===========================                         |53.0343% ~11 s remaining  
|===========================                         |53.29815% ~11 s remaining 
|===========================                         |53.56201% ~11 s remaining 
|===========================                         |53.82586% ~11 s remaining 
|============================                        |54.08971% ~11 s remaining 
|============================                        |54.35356% ~11 s remaining 
|============================                        |54.61741% ~10 s remaining 
|============================                        |54.88127% ~10 s remaining 
|============================                        |55.14512% ~10 s remaining 
|============================                        |55.40897% ~10 s remaining 
|============================                        |55.67282% ~10 s remaining 
|=============================                       |55.93668% ~10 s remaining 
|=============================                       |56.20053% ~10 s remaining 
|=============================                       |56.46438% ~10 s remaining 
|=============================                       |56.72823% ~10 s remaining 
|=============================                       |56.99208% ~10 s remaining 
|=============================                       |57.25594% ~10 s remaining 
|=============================                       |57.51979% ~10 s remaining 
|==============================                      |57.78364% ~10 s remaining 
|==============================                      |58.04749% ~10 s remaining 
|==============================                      |58.31135% ~10 s remaining 
|==============================                      |58.5752% ~10 s remaining  
|==============================                      |58.83905% ~10 s remaining 
|==============================                      |59.1029% ~9 s remaining   
|==============================                      |59.36675% ~9 s remaining  
|===============================                     |59.63061% ~9 s remaining  
|===============================                     |59.89446% ~9 s remaining  
|===============================                     |60.15831% ~9 s remaining  
|===============================                     |60.42216% ~9 s remaining  
|===============================                     |60.68602% ~9 s remaining  
|===============================                     |60.94987% ~9 s remaining  
|===============================                     |61.21372% ~9 s remaining  
|===============================                     |61.47757% ~9 s remaining  
|================================                    |61.74142% ~9 s remaining  
|================================                    |62.00528% ~9 s remaining  
|================================                    |62.26913% ~9 s remaining  
|================================                    |62.53298% ~9 s remaining  
|================================                    |62.79683% ~9 s remaining  
|================================                    |63.06069% ~9 s remaining  
|================================                    |63.32454% ~9 s remaining  
|=================================                   |63.58839% ~9 s remaining  
|=================================                   |63.85224% ~8 s remaining  
|=================================                   |64.11609% ~8 s remaining  
|=================================                   |64.37995% ~8 s remaining  
|=================================                   |64.6438% ~8 s remaining   
|=================================                   |64.90765% ~8 s remaining  
|=================================                   |65.1715% ~8 s remaining   
|==================================                  |65.43536% ~8 s remaining  
|==================================                  |65.69921% ~8 s remaining  
|==================================                  |65.96306% ~8 s remaining  
|==================================                  |66.22691% ~8 s remaining  
|==================================                  |66.49077% ~8 s remaining  
|==================================                  |66.75462% ~8 s remaining  
|==================================                  |67.01847% ~8 s remaining  
|==================================                  |67.28232% ~8 s remaining  
|===================================                 |67.54617% ~8 s remaining  
|===================================                 |67.81003% ~8 s remaining  
|===================================                 |68.07388% ~7 s remaining  
|===================================                 |68.33773% ~7 s remaining  
|===================================                 |68.60158% ~7 s remaining  
|===================================                 |68.86544% ~7 s remaining  
|===================================                 |69.12929% ~7 s remaining  
|====================================                |69.39314% ~7 s remaining  
|====================================                |69.65699% ~7 s remaining  
|====================================                |69.92084% ~7 s remaining  
|====================================                |70.1847% ~7 s remaining   
|====================================                |70.44855% ~7 s remaining  
|====================================                |70.7124% ~7 s remaining   
|====================================                |70.97625% ~7 s remaining  
|=====================================               |71.24011% ~7 s remaining  
|=====================================               |71.50396% ~7 s remaining  
|=====================================               |71.76781% ~7 s remaining  
|=====================================               |72.03166% ~7 s remaining  
|=====================================               |72.29551% ~6 s remaining  
|=====================================               |72.55937% ~6 s remaining  
|=====================================               |72.82322% ~6 s remaining  
|======================================              |73.08707% ~6 s remaining  
|======================================              |73.35092% ~6 s remaining  
|======================================              |73.61478% ~6 s remaining  
|======================================              |73.87863% ~6 s remaining  
|======================================              |74.14248% ~6 s remaining  
|======================================              |74.40633% ~6 s remaining  
|======================================              |74.67018% ~6 s remaining  
|======================================              |74.93404% ~6 s remaining  
|=======================================             |75.19789% ~6 s remaining  
|=======================================             |75.46174% ~6 s remaining  
|=======================================             |75.72559% ~6 s remaining  
|=======================================             |75.98945% ~6 s remaining  
|=======================================             |76.2533% ~6 s remaining   
|=======================================             |76.51715% ~5 s remaining  
|=======================================             |76.781% ~5 s remaining    
|========================================            |77.04485% ~5 s remaining  
|========================================            |77.30871% ~5 s remaining  
|========================================            |77.57256% ~5 s remaining  
|========================================            |77.83641% ~5 s remaining  
|========================================            |78.10026% ~5 s remaining  
|========================================            |78.36412% ~5 s remaining  
|========================================            |78.62797% ~5 s remaining  
|=========================================           |78.89182% ~5 s remaining  
|=========================================           |79.15567% ~5 s remaining  
|=========================================           |79.41953% ~5 s remaining  
|=========================================           |79.68338% ~5 s remaining  
|=========================================           |79.94723% ~5 s remaining  
|=========================================           |80.21108% ~5 s remaining  
|=========================================           |80.47493% ~5 s remaining  
|=========================================           |80.73879% ~4 s remaining  
|==========================================          |81.00264% ~4 s remaining  
|==========================================          |81.26649% ~4 s remaining  
|==========================================          |81.53034% ~4 s remaining  
|==========================================          |81.7942% ~4 s remaining   
|==========================================          |82.05805% ~4 s remaining  
|==========================================          |82.3219% ~4 s remaining   
|==========================================          |82.58575% ~4 s remaining  
|===========================================         |82.8496% ~4 s remaining   
|===========================================         |83.11346% ~4 s remaining  
|===========================================         |83.37731% ~4 s remaining  
|===========================================         |83.64116% ~4 s remaining  
|===========================================         |83.90501% ~4 s remaining  
|===========================================         |84.16887% ~4 s remaining  
|===========================================         |84.43272% ~4 s remaining  
|============================================        |84.69657% ~4 s remaining  
|============================================        |84.96042% ~4 s remaining  
|============================================        |85.22427% ~3 s remaining  
|============================================        |85.48813% ~3 s remaining  
|============================================        |85.75198% ~3 s remaining  
|============================================        |86.01583% ~3 s remaining  
|============================================        |86.27968% ~3 s remaining  
|=============================================       |86.54354% ~3 s remaining  
|=============================================       |86.80739% ~3 s remaining  
|=============================================       |87.07124% ~3 s remaining  
|=============================================       |87.33509% ~3 s remaining  
|=============================================       |87.59894% ~3 s remaining  
|=============================================       |87.8628% ~3 s remaining   
|=============================================       |88.12665% ~3 s remaining  
|=============================================       |88.3905% ~3 s remaining   
|==============================================      |88.65435% ~3 s remaining  
|==============================================      |88.91821% ~3 s remaining  
|==============================================      |89.18206% ~3 s remaining  
|==============================================      |89.44591% ~2 s remaining  
|==============================================      |89.70976% ~2 s remaining  
|==============================================      |89.97361% ~2 s remaining  
|==============================================      |90.23747% ~2 s remaining  
|===============================================     |90.50132% ~2 s remaining  
|===============================================     |90.76517% ~2 s remaining  
|===============================================     |91.02902% ~2 s remaining  
|===============================================     |91.29288% ~2 s remaining  
|===============================================     |91.55673% ~2 s remaining  
|===============================================     |91.82058% ~2 s remaining  
|===============================================     |92.08443% ~2 s remaining  
|================================================    |92.34828% ~2 s remaining  
|================================================    |92.61214% ~2 s remaining  
|================================================    |92.87599% ~2 s remaining  
|================================================    |93.13984% ~2 s remaining  
|================================================    |93.40369% ~2 s remaining  
|================================================    |93.66755% ~1 s remaining  
|================================================    |93.9314% ~1 s remaining   
|================================================    |94.19525% ~1 s remaining  
|=================================================   |94.4591% ~1 s remaining   
|=================================================   |94.72296% ~1 s remaining  
|=================================================   |94.98681% ~1 s remaining  
|=================================================   |95.25066% ~1 s remaining  
|=================================================   |95.51451% ~1 s remaining  
|=================================================   |95.77836% ~1 s remaining  
|=================================================   |96.04222% ~1 s remaining  
|==================================================  |96.30607% ~1 s remaining  
|==================================================  |96.56992% ~1 s remaining  
|==================================================  |96.83377% ~1 s remaining  
|==================================================  |97.09763% ~1 s remaining  
|==================================================  |97.36148% ~1 s remaining  
|==================================================  |97.62533% ~1 s remaining  
|==================================================  |97.88918% ~0 s remaining  
|=================================================== |98.15303% ~0 s remaining  
|=================================================== |98.41689% ~0 s remaining  
|=================================================== |98.68074% ~0 s remaining  
|=================================================== |98.94459% ~0 s remaining  
|=================================================== |99.20844% ~0 s remaining  
|=================================================== |99.4723% ~0 s remaining   
|=================================================== |99.73615% ~0 s remaining  
|====================================================|100% ~0 s remaining       
|====================================================|100%                      Completed after 23 s
```

```
## Starting to add information to samples
```

```
##  => Add clinical information to samples
```

```
## Add FFPE information. More information at: 
## => https://cancergenome.nih.gov/cancersselected/biospeccriteria 
## => http://gdac.broadinstitute.org/runs/sampleReports/latest/FPPP_FFPE_Cases.html
```

```
##  => Adding subtype information to samples
```

```
## Accessing www.ensembl.org to get gene information
```

```
## Accessing www.ensembl.org (mirror useast)
```

```
## Downloading genome information (try:1) Using: Human genes (GRCh38.p13)
```

```
## From the 60483 genes we couldn't map 3984
```

---
## TCGA Biolinks
[TCGABiolink](https://bioconductor.org/packages/release/bioc/html/TCGAbiolinks.html) - docker image!

---
## Ovarian Cancer - TCGA data
### Of note, Output from the GDCprepare: 
  * GDCquery: Searching in GDC database
    * Genome of reference: hg38
  * Accessing GDC. This might take a while...
  * Project: TCGA-OV
  * Filtering results
    * By experimental.strategy
    * By data.type
    * By workflow.type
  * Checking data
    * Check if there are duplicated cases
    * Check if there results for the query
  *  Preparing output
    * Downloading data for project TCGA-OV
    * GDCdownload will download '''379''' files. A total of 97.709866 MB
    * Downloading as: Mon_Feb__3_20_24_38_2020.tar.gz
---

### Of note, Output from the GDCprepare: Cont'd

Starting to add information to samples
    * Add clinical information to samples
 
Add FFPE information. More information at: 
    * https://cancergenome.nih.gov/cancersselected/biospeccriteria 
    * http://gdac.broadinstitute.org/runs/sampleReports/latest/FPPP_FFPE_Cases.html
    * Adding subtype information to samples

Accessing www.ensembl.org to get gene information
    * Downloading genome information (try:0) Using: Human genes (GRCh38.p13)
From the 60483 genes we couldn't map 3984"

---

## Experimental Design?

--
<img src=./images/img_lecture5/OV_classes.png>

<font size=2>Verhaak el al. Cancer Genome Atlas Research Network. Prognostically relevant gene signatures of high-grade serous ovarian carcinoma. J Clin Invest. 2013 Jan;123(1):517-25.[PMID](https://www.ncbi.nlm.nih.gov/pubmed/23257362)</font>

---

Load in the predefined classes as described in the Verhaak et al paper.

```r
classDefinitions_RNASeq <- read.table( 
  file.path("data", "Supplementary_Table11_RNASeq_classdefinitions.txt"), 
  header = TRUE, sep = "\t", quote="\"", stringsAsFactors = FALSE)

tcga.read.counts <- assay(OVRnaseqSE_counts)
colnames(tcga.read.counts) <- gsub(colnames(tcga.read.counts),
                                   pattern = "-",replacement = "\\.")
```

How many of the samples in the Verhaak paper are in out TCGA data

```r
length(which(classDefinitions_RNASeq$patient %in% colnames(tcga.read.counts)))
```

```
## [1] 257
```

---

Add the missing samples to the class definitions table

```r
missing_patients <- colnames(tcga.read.counts)[
  which(!colnames(tcga.read.counts) %in% classDefinitions_RNASeq$patient)]

missing_subtypes <- data.frame(barcode = substring(missing_patients,1,12),
                               patient =missing_patients , 
                               SUBTYPE = "Not_defined")
classDefinitions_RNASeq <- rbind(classDefinitions_RNASeq,
                                missing_subtypes )
classDefinitions_RNASeq <- classDefinitions_RNASeq[
  which(classDefinitions_RNASeq$patient %in% colnames(tcga.read.counts)),]

classDefinitions_RNASeq <- classDefinitions_RNASeq[order(classDefinitions_RNASeq$patient),]
tcga.read.counts <- tcga.read.counts[,order(colnames(tcga.read.counts))]
```

---
filter the data

```r
cpms <- cpm(tcga.read.counts)
keep <- rowSums(cpms > 1) >= 50
counts <- tcga.read.counts[keep,]
```

--
Normalize the data

```r
# create data structure to hold counts and subtype information for each sample.
d <- DGEList(counts=counts, group=classDefinitions_RNASeq$SUBTYPE)

#Normalize the data
d <- calcNormFactors(d)
```

---
Plot MDS plot of samples

```r
mds_filename <- file.path("data", "mdsplot_allsamples.png")
png(filename = mds_filename)
mds_output <- plotMDS(d, labels=NULL, pch = 1, 
col= c("darkgreen","blue","red", "orange","black")[factor(classDefinitions_RNASeq$SUBTYPE)])

legend("topright", 
       legend=levels(factor(classDefinitions_RNASeq$SUBTYPE)), 
       pch=c(1), col= c("darkgreen","blue","red", "orange","black"),
       title="Class",  
       bty = 'n', cex = 0.75)

dev.off()
```

```
## quartz_off_screen 
##                 2
```

---

---

At this stage I am going to reduce the samples to only the ones we have subtype information for.

```r
keep_samples <- classDefinitions_RNASeq$patient[
  classDefinitions_RNASeq$SUBTYPE != "Not_defined"]

classDefinitions_RNASeq <- classDefinitions_RNASeq[  classDefinitions_RNASeq$SUBTYPE != "Not_defined",]
counts <- counts[,keep_samples]
```

Normalize the data

```r
# create data structure to hold counts and subtype information for each sample.
d <- DGEList(counts=counts, group=classDefinitions_RNASeq$SUBTYPE)

#Normalize the data
d <- calcNormFactors(d)
```

---
Plot MDS plot of samples

```r
mds_filename <- file.path("data", "mdsplot_allsamples_minus_undef.png")
png(filename = mds_filename)
mds_output <- plotMDS(d, labels=NULL, pch = 1, 
col= c("darkgreen","blue","red", "orange","black")[factor(classDefinitions_RNASeq$SUBTYPE)])

legend("topright", 
       legend=levels(factor(classDefinitions_RNASeq$SUBTYPE)), 
       pch=c(1), col= c("darkgreen","blue","red", "orange"),
       title="Class",  
       bty = 'n', cex = 0.75)

dev.off()
```

```
## quartz_off_screen 
##                 2
```

---

---

Define the model matrix

```r
classes <- classDefinitions_RNASeq$SUBTYPE
model_design_tcga <- model.matrix(~ 0 + classes)
model_design_tcga[1:5,1:4]
```

```
##   classesDifferentiated classesImmunoreactive classesMesenchymal
## 1                     0                     1                  0
## 2                     1                     0                  0
## 3                     0                     0                  0
## 4                     0                     1                  0
## 5                     0                     0                  0
##   classesProliferative
## 1                    0
## 2                    0
## 3                    1
## 4                    0
## 5                    1
```

---

Calculate dispersion

```r
d <- estimateDisp(d,model_design_tcga)
```

---
Graphing the BCV
  * tagwise = genewise, each dot represents the BCV for a gene

```r
plotBCV(d,col.tagwise = "black",col.common = "red")
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-77-1.png)

---

```r
plotMeanVar(d, show.raw.vars = TRUE, show.tagwise.vars=TRUE, 
            show.ave.raw.vars = TRUE,  
*           NBline=TRUE,
            show.binned.common.disp.vars = TRUE)
```

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-78-1.png)

---

Calculate differential expression
  * We have a lot of different option to look at here - Immuno subtype vs mesenchymal

```r
contrast_mesenvsimmuno <- makeContrasts(
                  mesenvsimmuno ="classesMesenchymal-classesImmunoreactive",
                  levels=model_design_tcga)

contrast_mesenvsimmuno
```

```
##                        Contrasts
## Levels                  mesenvsimmuno
##   classesDifferentiated             0
##   classesImmunoreactive            -1
##   classesMesenchymal                1
##   classesProliferative              0
```

---

```r
fit_qlf_tcga <-glmQLFit (d,model_design_tcga)

qlf.immuno_vs_mesechymal <- glmQLFTest(fit_qlf_tcga, 
                                       contrast=contrast_mesenvsimmuno)

tt_mesenvsimmuno <- topTags(qlf.immuno_vs_mesechymal,n=nrow(d))
```

---
top hits

```r
#merge in the gene names first
ovRNASeq_gene_countsdata <- rowData(OVRnaseqSE_counts)

data_display <- merge(ovRNASeq_gene_countsdata[,1:2],
                      topTags(qlf.immuno_vs_mesechymal),
                      by.x=1, by.y = 0)

kable(data_display, type="html")
```

<table>
 <thead>
  <tr>
   <th style="text-align:left;"> ensembl_gene_id </th>
   <th style="text-align:left;"> external_gene_name </th>
   <th style="text-align:right;"> logFC </th>
   <th style="text-align:right;"> logCPM </th>
   <th style="text-align:right;"> F </th>
   <th style="text-align:right;"> PValue </th>
   <th style="text-align:right;"> FDR </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:left;"> ENSG00000084636 </td>
   <td style="text-align:left;"> COL16A1 </td>
   <td style="text-align:right;"> 1.830897 </td>
   <td style="text-align:right;"> 5.407136 </td>
   <td style="text-align:right;"> 120.0345 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000103196 </td>
   <td style="text-align:left;"> CRISPLD2 </td>
   <td style="text-align:right;"> 2.182952 </td>
   <td style="text-align:right;"> 5.473646 </td>
   <td style="text-align:right;"> 108.7335 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000106624 </td>
   <td style="text-align:left;"> AEBP1 </td>
   <td style="text-align:right;"> 2.086450 </td>
   <td style="text-align:right;"> 8.644920 </td>
   <td style="text-align:right;"> 115.0045 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000113140 </td>
   <td style="text-align:left;"> SPARC </td>
   <td style="text-align:right;"> 1.694264 </td>
   <td style="text-align:right;"> 10.538137 </td>
   <td style="text-align:right;"> 108.9378 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000133466 </td>
   <td style="text-align:left;"> C1QTNF6 </td>
   <td style="text-align:right;"> 1.572266 </td>
   <td style="text-align:right;"> 4.956225 </td>
   <td style="text-align:right;"> 107.9188 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000136859 </td>
   <td style="text-align:left;"> ANGPTL2 </td>
   <td style="text-align:right;"> 1.539721 </td>
   <td style="text-align:right;"> 5.191807 </td>
   <td style="text-align:right;"> 122.2606 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000166147 </td>
   <td style="text-align:left;"> FBN1 </td>
   <td style="text-align:right;"> 2.116491 </td>
   <td style="text-align:right;"> 6.015916 </td>
   <td style="text-align:right;"> 121.9697 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000169604 </td>
   <td style="text-align:left;"> ANTXR1 </td>
   <td style="text-align:right;"> 1.664972 </td>
   <td style="text-align:right;"> 7.412542 </td>
   <td style="text-align:right;"> 135.3873 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000174498 </td>
   <td style="text-align:left;"> IGDCC3 </td>
   <td style="text-align:right;"> 5.822141 </td>
   <td style="text-align:right;"> 2.501262 </td>
   <td style="text-align:right;"> 123.3080 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000182492 </td>
   <td style="text-align:left;"> BGN </td>
   <td style="text-align:right;"> 1.790193 </td>
   <td style="text-align:right;"> 8.989584 </td>
   <td style="text-align:right;"> 107.8897 </td>
   <td style="text-align:right;"> 0 </td>
   <td style="text-align:right;"> 0 </td>
  </tr>
</tbody>
</table>

---

```r
kable(data_display, type="html",digits = 32)
```

<table>
 <thead>
  <tr>
   <th style="text-align:left;"> ensembl_gene_id </th>
   <th style="text-align:left;"> external_gene_name </th>
   <th style="text-align:right;"> logFC </th>
   <th style="text-align:right;"> logCPM </th>
   <th style="text-align:right;"> F </th>
   <th style="text-align:right;"> PValue </th>
   <th style="text-align:right;"> FDR </th>
  </tr>
 </thead>
<tbody>
  <tr>
   <td style="text-align:left;"> ENSG00000084636 </td>
   <td style="text-align:left;"> COL16A1 </td>
   <td style="text-align:right;"> 1.830897 </td>
   <td style="text-align:right;"> 5.407136 </td>
   <td style="text-align:right;"> 120.0345 </td>
   <td style="text-align:right;"> 3.545814e-23 </td>
   <td style="text-align:right;"> 1.359891e-19 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000103196 </td>
   <td style="text-align:left;"> CRISPLD2 </td>
   <td style="text-align:right;"> 2.182952 </td>
   <td style="text-align:right;"> 5.473646 </td>
   <td style="text-align:right;"> 108.7335 </td>
   <td style="text-align:right;"> 1.832311e-21 </td>
   <td style="text-align:right;"> 4.392049e-18 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000106624 </td>
   <td style="text-align:left;"> AEBP1 </td>
   <td style="text-align:right;"> 2.086450 </td>
   <td style="text-align:right;"> 8.644920 </td>
   <td style="text-align:right;"> 115.0045 </td>
   <td style="text-align:right;"> 2.021539e-22 </td>
   <td style="text-align:right;"> 6.460840e-19 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000113140 </td>
   <td style="text-align:left;"> SPARC </td>
   <td style="text-align:right;"> 1.694264 </td>
   <td style="text-align:right;"> 10.538137 </td>
   <td style="text-align:right;"> 108.9378 </td>
   <td style="text-align:right;"> 1.704300e-21 </td>
   <td style="text-align:right;"> 4.392049e-18 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000133466 </td>
   <td style="text-align:left;"> C1QTNF6 </td>
   <td style="text-align:right;"> 1.572266 </td>
   <td style="text-align:right;"> 4.956225 </td>
   <td style="text-align:right;"> 107.9188 </td>
   <td style="text-align:right;"> 2.446857e-21 </td>
   <td style="text-align:right;"> 4.491265e-18 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000136859 </td>
   <td style="text-align:left;"> ANGPTL2 </td>
   <td style="text-align:right;"> 1.539721 </td>
   <td style="text-align:right;"> 5.191807 </td>
   <td style="text-align:right;"> 122.2606 </td>
   <td style="text-align:right;"> 1.653666e-23 </td>
   <td style="text-align:right;"> 8.756399e-20 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000166147 </td>
   <td style="text-align:left;"> FBN1 </td>
   <td style="text-align:right;"> 2.116491 </td>
   <td style="text-align:right;"> 6.015916 </td>
   <td style="text-align:right;"> 121.9697 </td>
   <td style="text-align:right;"> 1.826533e-23 </td>
   <td style="text-align:right;"> 8.756399e-20 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000169604 </td>
   <td style="text-align:left;"> ANTXR1 </td>
   <td style="text-align:right;"> 1.664972 </td>
   <td style="text-align:right;"> 7.412542 </td>
   <td style="text-align:right;"> 135.3873 </td>
   <td style="text-align:right;"> 2.016424e-25 </td>
   <td style="text-align:right;"> 3.866694e-21 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000174498 </td>
   <td style="text-align:left;"> IGDCC3 </td>
   <td style="text-align:right;"> 5.822141 </td>
   <td style="text-align:right;"> 2.501261 </td>
   <td style="text-align:right;"> 123.3080 </td>
   <td style="text-align:right;"> 1.156833e-23 </td>
   <td style="text-align:right;"> 8.756399e-20 </td>
  </tr>
  <tr>
   <td style="text-align:left;"> ENSG00000182492 </td>
   <td style="text-align:left;"> BGN </td>
   <td style="text-align:right;"> 1.790193 </td>
   <td style="text-align:right;"> 8.989584 </td>
   <td style="text-align:right;"> 107.8897 </td>
   <td style="text-align:right;"> 2.472275e-21 </td>
   <td style="text-align:right;"> 4.491265e-18 </td>
  </tr>
</tbody>
</table>

---

How many genes have p-values less than 0.05
--

```r
length(which(tt_mesenvsimmuno$table$PValue<0.05))
```

```
## [1] 7521
```

How many genes pass correction?
--

```r
length(which(tt_mesenvsimmuno$table$FDR < 0.05))
```

```
## [1] 5559
```

---
Try a different comparison:
  * compare immuno to the rest of the samples (not undefined though)

```r
contrast_immuno <- makeContrasts(
  immunovsrest ="classesImmunoreactive-(classesMesenchymal + 
  classesProliferative +classesDifferentiated)/3",
  levels=model_design_tcga)

qlf.immuno_vs_all <- glmQLFTest(fit_qlf_tcga, 
                                       contrast=contrast_immuno)

tt_immunovsall <- topTags(qlf.immuno_vs_all,n=nrow(d))
```

---

How many genes have p-values less than 0.05
--

```r
length(which(tt_immunovsall$table$PValue<0.05))
```

```
## [1] 8178
```

How many genes pass correction?
--

```r
length(which(tt_immunovsall$table$FDR < 0.05))
```

```
## [1] 6258
```

---

Visualize this data set

```r
# get the normalized counts
tcga_normalized_counts <- log2(cpm(d) +1)

#create the scaled heatmap object
heatmap_matrix <- tcga_normalized_counts

*top_hits <- rownames(tt_immunovsall)[which(tt_immunovsall$table$FDR < 0.001)]
heatmap_matrix_tophits <- t(
  scale(t(heatmap_matrix[which(rownames(heatmap_matrix) %in% top_hits),])))

current_heatmap <- Heatmap(as.matrix(heatmap_matrix_tophits),
                  cluster_rows = TRUE,  show_row_dend = TRUE,
*                 cluster_columns = TRUE,show_column_dend = FALSE,
                  col=heatmap_col,show_column_names = FALSE, 
                  show_row_names = FALSE,show_heatmap_legend = TRUE)
```

---
Immuno vs Rest heatmap

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-89-1.png)

---

Annotating the heatmap could really help here.

```r
ha_colours <- c("darkgreen","blue","red", "orange")
names(ha_colours) <- unique(classDefinitions_RNASeq$SUBTYPE)

ha <- HeatmapAnnotation(df=data.frame(
  type = classDefinitions_RNASeq$SUBTYPE),
  col =  list(type = ha_colours))

current_heatmap <- Heatmap(as.matrix(heatmap_matrix_tophits),
                  cluster_rows = TRUE,  show_row_dend = TRUE,
                  cluster_columns = TRUE,show_column_dend = FALSE,
                  col=heatmap_col,show_column_names = FALSE, 
                  show_row_names = FALSE,show_heatmap_legend = TRUE,
*                 top_annotation = ha)
```

---
Immuno vs Rest heatmap - annotated

![](lecture5_differential_expression_files/figure-html/unnamed-chunk-91-1.png)

---
## Homework for next week

Next week we will be looking at "What do we do with all these hits?"

* Find an annotation data set (excluding GO and Reactome) for human genes.
  * Any data set that adds functional, process or location data to a set of genes.
  * Record in your journal and add it to the list of annotation sources on the Student Wiki:
    * When was it published?  Was is published?
    * How is it released? What identifiers does it use?
    * What sort of information does it offer us?