# Differential abundance testing with Milo

Emma Dann and Mike Morgan

#### 27 April 2022

#### Package

miloR 1.4.0

    library(miloR)
    library(SingleCellExperiment)
    library(scater)
    library(scran)
    library(dplyr)
    library(patchwork)

# 1 Introduction

Milo is a tool for analysis of complex single cell datasets generated from replicated multi-condition experiments, which detects changes in composition between conditions. While differential abundance (DA) is commonly quantified in discrete cell clusters, Milo uses partially overlapping neighbourhoods of cells on a KNN graph. Starting from a graph that faithfully recapitulates the biology of the cell population, Milo analysis consists of 3 steps:

1. Sampling of representative neighbourhoods
2. Testing for differential abundance of conditions in all neighbourhoods
3. Accounting for multiple hypothesis testing using a weighted FDR procedure that accounts for the overlap of neighbourhoods

In this vignette we will elaborate on how these steps are implemented in the `miloR` package.

# 2 Load data

For this demo we will use a synthetic dataset simulating a developmental trajectory, generated using dyntoy.

    data("sim_trajectory", package = "miloR")

    ## Extract SingleCellExperiment object
    traj_sce <- sim_trajectory[['SCE']]

    ## Extract sample metadata to use for testing
    traj_meta <- sim_trajectory[["meta"]]

    ## Add metadata to colData slot
    colData(traj_sce) <- DataFrame(traj_meta)

# 3 Pre-processing

For DA analysis we need to construct an undirected KNN graph of single-cells. Standard single-cell analysis pipelines usually do this from distances in PCA. We normalize and calculate principal components using `scater`. I also run UMAP for visualization purposes.

    logcounts(traj_sce) <- log(counts(traj_sce) + 1)
    traj_sce <- runPCA(traj_sce, ncomponents=30)
    traj_sce <- runUMAP(traj_sce)

    plotUMAP(traj_sce)

# 4 Create a Milo object

For differential abundance analysis on graph neighbourhoods we first construct a `Milo` object. This extends the `SingleCellExperiment` class to store information about neighbourhoods on the KNN graph.

## 4.1 From SingleCellExperiment object

The `Milo` constructor takes as input a `SingleCellExperiment` object.

    traj_milo <- Milo(traj_sce)
    reducedDim(traj_milo, "UMAP") <- reducedDim(traj_sce, "UMAP")

    traj_milo

    ## class: Milo
    ## dim: 500 500
    ## metadata(0):
    ## assays(2): counts logcounts
    ## rownames(500): G1 G2 ... G499 G500
    ## rowData names(0):
    ## colnames: NULL
    ## colData names(5): cell_id group_id Condition Replicate Sample
    ## reducedDimNames(2): PCA UMAP
    ## mainExpName: NULL
    ## altExpNames(0):
    ## nhoods dimensions(2): 1 1
    ## nhoodCounts dimensions(2): 1 1
    ## nhoodDistances dimension(1): 0
    ## graph names(0):
    ## nhoodIndex names(1): 0
    ## nhoodExpression dimension(2): 1 1
    ## nhoodReducedDim names(0):
    ## nhoodGraph names(0):
    ## nhoodAdjacency dimension(2): 1 1

## 4.2 From AnnData object (.h5ad)

We can use the `zellkonverter` package to make a `SingleCellExperiment` object from an `AnnData` object stored as `h5ad` file.

    library(zellkonverter)

    # Obtaining an example H5AD file.
    example_h5ad <- system.file("extdata", "krumsiek11.h5ad",
                                package = "zellkonverter")

    example_h5ad_sce <- readH5AD(example_h5ad)
    example_h5ad_milo <- Milo(example_h5ad_sce)

## 4.3 From Seurat object

The `Seurat` package includes a converter to `SingleCellExperiment`.

    library(Seurat)
    data("pbmc_small")
    pbmc_small_sce <- as.SingleCellExperiment(pbmc_small)
    pbmc_small_milo <- Milo(pbmc_small_sce)

# 5 Construct KNN graph

We need to add the KNN graph to the Milo object. This is stored in the `graph` slot, in `igraph` format. The `miloR` package includes functionality to build and store the graph from the PCA dimensions stored in the `reducedDim` slot.

    traj_milo <- buildGraph(traj_milo, k = 10, d = 30)

    ## Constructing kNN graph with k:10

In progress: we are perfecting the functionality to add a precomputed KNN graph (for example constructed with Seurat or scanpy) to the `graph` slot using the adjacency matrix.

# 6 1. Defining representative neighbourhoods

We define the neighbourhood of a cell, the index, as the group of cells connected by an edge in the KNN graph to the index cell. For efficiency, we don’t test for DA in the neighbourhood of every cell, but we sample as indices a subset of representative cells, using a KNN sampling algorithm used by Gut et al. 2015.

For sampling you need to define a few parameters:

- `prop`: the proportion of cells to randomly sample to start with (usually 0.1 - 0.2 is sufficient)
- `k`: the k to use for KNN refinement (we recommend using the same k used for KNN graph building)
- `d`: the number of reduced dimensions to use for KNN refinement (we recommend using the same d used for KNN graph building)
- `refined` indicated whether you want to use the sampling refinement algorithm, or just pick cells at random. The default and recommended way to go is to use refinement. The only situation in which you might consider using random instead, is if you have batch corrected your data with a graph based correction algorithm, such as BBKNN, but the results of DA testing will be suboptimal.

    traj_milo <- makeNhoods(traj_milo, prop = 0.1, k = 10, d=30, refined = TRUE)

    ## Checking valid object

    ## Running refined sampling with reduced_dim

    ## Warning in .refined_sampling(random_vertices, X_reduced_dims, k): Rownames not
    ## set on reducedDims - setting to row indices

Once we have defined neighbourhoods, it’s good to take a look at how big the neighbourhoods are (i.e. how many cells form each neighbourhood). This affects the power of DA testing. We can check this out using the `plotNhoodSizeHist` function. Empirically, we found it’s best to have a distribution peaking between 50 and 100. Otherwise you might consider rerunning `makeNhoods` increasing `k` and/or `prop` (here the distribution looks ludicrous because it’s a small dataset).

    plotNhoodSizeHist(traj_milo)

# 7 Counting cells in neighbourhoods

Now we have to count how many cells from each sample are in each neighbourhood. We need to use the cell metadata and specify which column contains the sample information.

    traj_milo <- countCells(traj_milo, meta.data = data.frame(colData(traj_milo)), samples="Sample")

    ## Checking meta.data validity

    ## Counting cells in neighbourhoods

This adds to the `Milo` object a `n \times m` matrix, where n is the number of neighbourhoods and \(m\) is the number of experimental samples. Values indicate the number of cells from each sample counted in a neighbourhood. This count matrix will be used for DA testing.

    head(nhoodCounts(traj_milo))

    ## 6 x 6 sparse Matrix of class "dgCMatrix"
    ##   B_R1 A_R1 A_R2 B_R2 B_R3 A_R3
    ## 1    9    6    7    7    6   10
    ## 2   13    2    1   19   21    1
    ## 3    6    7    5   12    8   11
    ## 4    7    .    1    6   14    .
    ## 5    4    4    4    8    9    6
    ## 6    4    7    3    3    5    6

# 8 Differential abundance testing

Now we are all set to test for differential abundance in neighbourhoods. We implement this hypothesis testing in a generalized linear model (GLM) framework, specifically using the Negative Binomial GLM implementation in `edgeR`.

We first need to think about our experimental design. The design matrix should match samples to a condition of interest. In this case the `Condition` is the covariate we are going to test for.

    traj_design <- data.frame(colData(traj_milo))[,c("Sample", "Condition")]
    traj_design <- distinct(traj_design)
    rownames(traj_design) <- traj_design$Sample
    ## Reorder rownames to match columns of nhoodCounts(milo)
    traj_design <- traj_design[colnames(nhoodCounts(traj_milo)), , drop=FALSE]

    traj_design

    ##      Sample Condition
    ## B_R1   B_R1         B
    ## A_R1   A_R1         A
    ## A_R2   A_R2         A
    ## B_R2   B_R2         B
    ## B_R3   B_R3         B
    ## A_R3   A_R3         A

Milo uses an adaptation of the Spatial FDR correction introduced by cydar, which accounts for the overlap between neighbourhoods. Specifically, each hypothesis test P-value is weighted by the reciprocal of the kth nearest neighbour distance. To use this statistic we first need to store the distances between nearest neighbors in the Milo object.

    traj_milo <- calcNhoodDistance(traj_milo, d=30)

Now we can do the test, explicitly defining our experimental design.

    rownames(traj_design) <- traj_design$Sample
    da_results <- testNhoods(traj_milo, design = ~ Condition, design.df = traj_design)

    ## Using TMM normalisation

    ## Performing spatial FDR correction withk-distance weighting

This calculates a Fold-change and corrected P-value for each neighbourhood, which indicates whether there is significant differential abundance between conditions.

    da_results %>%
      arrange(- SpatialFDR) %>%
      head()

    ##          logFC   logCPM          F    PValue       FDR Nhood SpatialFDR
    ## 25 -0.09110035 15.28495 0.02890972 0.8710555 0.8710555    25  0.8710555
    ## 5  -0.26855724 15.55410 0.37251691 0.5844288 0.6060743     5  0.6061626
    ## 12  0.28287400 15.83228 0.69495291 0.5308262 0.5716590    12  0.5712624
    ## 15 -0.36625413 15.58449 0.80131709 0.4474103 0.5010995    15  0.5004196
    ## 18 -0.69751695 15.04399 0.72977719 0.3947790 0.4605754    18  0.4597779
    ## 22  0.41403604 15.90629 1.01050696 0.3490388 0.4249168    22  0.4228447

# 9 Visualize neighbourhoods displaying DA

To visualize DA results, we build an abstracted graph of neighbourhoods that we can superimpose on the single-cell embedding.

    traj_milo <- buildNhoodGraph(traj_milo)

    plotUMAP(traj_milo) + plotNhoodGraphDA(traj_milo, da_results, alpha=0.05) +
      plot_layout(guides="collect")

Session Info

    sessionInfo()

    ## R version 4.2.0 RC (2022-04-19 r82224 ucrt)
    ## Platform: x86_64-w64-mingw32/x64 (64-bit)
    ## Running under: Windows Server x64 (build 20348)
    ##
    ## Matrix products: default
    ##
    ## locale:
    ## [1] LC_COLLATE=C
    ## [2] LC_CTYPE=English_United States.utf8
    ## [3] LC_MONETARY=English_United States.utf8
    ## [4] LC_NUMERIC=C
    ## [5] LC_TIME=English_United States.utf8
    ##
    ## attached base packages:
    ## [1] stats4    stats     graphics  grDevices utils     datasets  methods
    ## [8] base
    ##
    ## other attached packages:
    ##  [1] MouseThymusAgeing_1.3.0     patchwork_1.1.1
    ##  [3] dplyr_1.0.8                 scran_1.24.0
    ##  [5] scater_1.24.0               ggplot2_3.3.5
    ##  [7] scuttle_1.6.0               SingleCellExperiment_1.18.0
    ##  [9] SummarizedExperiment_1.26.0 Biobase_2.56.0
    ## [11] GenomicRanges_1.48.0        GenomeInfoDb_1.32.0
    ## [13] IRanges_2.30.0              S4Vectors_0.34.0
    ## [15] BiocGenerics_0.42.0         MatrixGenerics_1.8.0
    ## [17] matrixStats_0.62.0          miloR_1.4.0
    ## [19] edgeR_3.38.0                limma_3.52.0
    ## [21] BiocStyle_2.24.0
    ##
    ## loaded via a namespace (and not attached):
    ##   [1] AnnotationHub_3.4.0           BiocFileCache_2.4.0
    ##   [3] igraph_1.3.1                  splines_4.2.0
    ##   [5] BiocParallel_1.30.0           digest_0.6.29
    ##   [7] htmltools_0.5.2               magick_2.7.3
    ##   [9] viridis_0.6.2                 fansi_1.0.3
    ##  [11] magrittr_2.0.3                memoise_2.0.1
    ##  [13] ScaledMatrix_1.4.0            cluster_2.1.3
    ##  [15] Biostrings_2.64.0             graphlayouts_0.8.0
    ##  [17] colorspace_2.0-3              blob_1.2.3
    ##  [19] rappdirs_0.3.3                ggrepel_0.9.1
    ##  [21] xfun_0.30                     crayon_1.5.1
    ##  [23] RCurl_1.98-1.6                jsonlite_1.8.0
    ##  [25] glue_1.6.2                    polyclip_1.10-0
    ##  [27] gtable_0.3.0                  zlibbioc_1.42.0
    ##  [29] XVector_0.36.0                DelayedArray_0.22.0
    ##  [31] BiocSingular_1.12.0           scales_1.2.0
    ##  [33] DBI_1.1.2                     Rcpp_1.0.8.3
    ##  [35] viridisLite_0.4.0             xtable_1.8-4
    ##  [37] dqrng_0.3.0                   bit_4.0.4
    ##  [39] rsvd_1.0.5                    metapod_1.4.0
    ##  [41] httr_1.4.2                    FNN_1.1.3
    ##  [43] RColorBrewer_1.1-3            ellipsis_0.3.2
    ##  [45] pkgconfig_2.0.3               farver_2.1.0
    ##  [47] uwot_0.1.11                   sass_0.4.1
    ##  [49] dbplyr_2.1.1                  locfit_1.5-9.5
    ##  [51] utf8_1.2.2                    labeling_0.4.2
    ##  [53] tidyselect_1.1.2              rlang_1.0.2
    ##  [55] later_1.3.0                   AnnotationDbi_1.58.0
    ##  [57] munsell_0.5.0                 BiocVersion_3.15.2
    ##  [59] tools_4.2.0                   cachem_1.0.6
    ##  [61] cli_3.3.0                     generics_0.1.2
    ##  [63] RSQLite_2.2.12                ExperimentHub_2.4.0
    ##  [65] evaluate_0.15                 stringr_1.4.0
    ##  [67] fastmap_1.1.0                 yaml_2.3.5
    ##  [69] knitr_1.39                    bit64_4.0.5
    ##  [71] tidygraph_1.2.1               purrr_0.3.4
    ##  [73] KEGGREST_1.36.0               ggraph_2.0.5
    ##  [75] sparseMatrixStats_1.8.0       mime_0.12
    ##  [77] compiler_4.2.0                png_0.1-7
    ##  [79] beeswarm_0.4.0                filelock_1.0.2
    ##  [81] curl_4.3.2                    interactiveDisplayBase_1.34.0
    ##  [83] tibble_3.1.6                  statmod_1.4.36
    ##  [85] tweenr_1.0.2                  bslib_0.3.1
    ##  [87] stringi_1.7.6                 highr_0.9
    ##  [89] RSpectra_0.16-1               lattice_0.20-45
    ##  [91] bluster_1.6.0                 Matrix_1.4-1
    ##  [93] vctrs_0.4.1                   pillar_1.7.0
    ##  [95] lifecycle_1.0.1               BiocManager_1.30.17
    ##  [97] jquerylib_0.1.4               BiocNeighbors_1.14.0
    ##  [99] cowplot_1.1.1                 bitops_1.0-7
    ## [101] irlba_2.3.5                   httpuv_1.6.5
    ## [103] R6_2.5.1                      bookdown_0.26
    ## [105] promises_1.2.0.1              gridExtra_2.3
    ## [107] vipor_0.4.5                   MASS_7.3-57
    ## [109] gtools_3.9.2                  assertthat_0.2.1
    ## [111] withr_2.5.0                   GenomeInfoDbData_1.2.8
    ## [113] parallel_4.2.0                grid_4.2.0
    ## [115] beachmat_2.12.0               tidyr_1.2.0
    ## [117] rmarkdown_2.14                DelayedMatrixStats_1.18.0
    ## [119] ggforce_0.3.3                 shiny_1.7.1
    ## [121] ggbeeswarm_0.6.0