National Academies Press: OpenBook

Neuroscience Trials of the Future: Proceedings of a Workshop (2016)

Chapter: 3 Clinical Trial Design

« Previous: 2 Neuroscience Clinical Trials: An Overview of Challenges and Potential Opportunities
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

3

Clinical Trial Design

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

Clinical trials are typically conducted in three phases prior to market approval: Phase I, to evaluate safety, determine a safe dose range, and identify side effects; Phase II, to further evaluate safety and assess efficacy; and Phase III, to confirm effectiveness, monitor side effects, and compare it to other treatments (U.S. National Library of Medicine, 2008). The goal of Phase II is “to obtain preliminary data on whether the drug works in people who have a certain disease or condition.”1 Failures in Phase II are also of substantial concern, said Steven Romano; approximately 80 percent of the compounds tested in Phase II fail. More than half of these fail for lack of efficacy (Arrowsmith and Miller, 2013), and another 30 percent because of a company’s shift in strategic focus, which could reflect a company’s concerns about comparative effectiveness and thus marketability. The fundamental challenge, according to Robert Bilder, professor-in-residence in the department of psychiatry and biobehavioral sciences at the University of California, Los Angeles, is the lack of validity for the “disease entities” associated with nervous system disorders, for which etiology and pathophysiology are mostly unknown. Both psychometric approaches and categorical approaches are insufficient for most disease entities, and heterogeneity within a syndrome and across syndromes is common, which could confound signal detection in Phase II trials. RDoC, described below, is one attempt to address these problems. In addition, several participants noted the need for better disease modeling—using both existing and new tools—and novel trial designs and statistical approaches.

ALTERNATIVES TO THE DSM

The DSM is a diagnostic tool that defines disorders as distinct entities and relies mainly on subjective measures—self-report from patients and clinicians’ observations—rather than on an advanced understanding of the neurobiology of disease (Casey et al., 2013), said Steven Romano. In addition, the DSM fails to capture a number of disease domains such as volition, motivation, and speech (Kendler, 2016). Bilder added that categorical systems for defining disease are generally considered less valid than systems that capture the dimensionality of most psychiatric conditions (e.g., Haslam et al., 2012). He added that a dimension such as cognitive impairment may arise from different fundamental causes in

___________________

1 See http://www.adaptimmune.com/patients-families/clinical-trial-faq (accessed June 23, 2016).

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

different disease states, such as cognitive dysfunction in major depressive disorder and schizophrenia. Nonetheless, it may be more valuable to assume that the dimensions are the same until they are shown to be different.

In recognition that drug development in psychiatry is significantly hampered by heterogeneity within diagnostic categories, NIMH established the RDoC initiative in 2009 to change how patients and non-patients are identified and classified for research purposes, and to encourage researchers to think about and study psychopathology in different ways. RDoC became a more dominant paradigm in 2013, when then-Director of NIMH, Thomas Insel, posted a message on his blog, indicating that NIMH was reorienting its research away from DSM categorical syndromic diagnoses in favor of an approach that took into account heterogeneity in diagnosis—essentially the RDoC approach. For example, diagnosing a major depressive episode requires a patient to exhibit five of nine symptoms. Many of these symptoms, such as sleep disruptions or hallucinations, occur across multiple diagnostic categories. With 126 possible combinations of those 9 symptoms, there is substantial heterogeneity among those diagnosed with depression. Moreover, the occurrence of symptoms across multiple diagnoses supports the notion that these disorders are not fully distinct, said Sarah Morris, acting head of the NIMH RDoC unit and program chief for schizophrenia spectrum disorders research. The primacy of neurobiology over phenomenology is further supported by data from the Psychiatric Genomics Consortium, which showed high rates of shared heritability among diagnoses (Cross-Disorder Group of the Psychiatric Genomics, Consortium, 2013). In another example, there is evidence of shared patterns of gray matter loss among patients with schizophrenia, bipolar disorder, depression, addiction, obsessive-compulsive disorder, and anxiety (Goodkind et al., 2015).

Instead of grouping patients into heterogeneous diagnostic groups, RDoC provides a framework for classifying participants according to neurobehavioral constructs, based on what is known about the brain and behavior, rather than by heterogeneous diagnoses. Morris emphasized that the framework is a hypothesis, which assumes a developmental perspective from prenatal to late life as well as the ubiquitous impact of the environment across that developmental trajectory. It frames classification in terms of five domains and constructs associated with those domains (see Table 3-1). The list is dynamic and flexible enough to change over

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

TABLE 3-1 RDoC Domains and Constructs

Domains Constructs
Cognitive systems Attention
Perception
Declarative memory
Language behavior
Cognitive (effortful) control
Working memory
Positive valence systems Approach motivation
Initial responsiveness to reward
Sustained responsiveness to reward
Reward learning
Habit
Negative valence systems Acute threat (“fear”)
Potential threat (“anxiety”)
Sustained threat
Loss
Frustrative non-reward
Arousal and regulatory systems Arousal
Circadian rhythms
Sleep and wakefulness
Systems for social processes Affiliation and attachment
Social communication
Perception and understanding of self
Perception and understanding of others

SOURCE: Presented by Sarah Morris at the Workshop on Neuroscience Trials of the Future, March 3, 2016.

time. It assumes dimensionality among disorders and between illness and health, as well as interaction among constructs. Constructs can be measured at multiple units of analysis (genes, molecules, cells, circuits, physiology, behavior, and self-report), each of which informs and constrains the others.

NIMH encourages investigators to adopt RDoC principles in their clinical trials by focusing on functional domains or symptoms, thus increasing the probability that participants’ disorders will share the same mechanism. Figure 3-1 illustrates NIMH’s vision of this approach (Insel and Cuthbert, 2015). RDoC also has a database that is integrated with other NIMH data-sharing resources, together providing data from more

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

than 100,000 subjects who are available for hypothesis testing or hypothesis generation.

Morris also mentioned that using the RDoC framework will require creativity with regard to recruiting a sample that provides the strongest test of a hypothesis, given that the treatment focus is on functional domains or symptoms rather than unitary diagnostic categories. Enrollment criteria could be diagnostically agnostic; an example is recruiting based on presence of a symptom such as psychosis regardless of the particular diagnosis (e.g., schizophrenia or some other disorder), or perhaps in the future, expression of a particular gene related to a psychopathologic mechanism. Alternatively, diagnoses could be used as a proxy for a symptom such as psychoses.

Image
FIGURE 3-1 RDoC in neuroscience trials of the future.
SOURCES: Presented by Sarah Morris at the Workshop on Neuroscience Trials of the Future, March 3, 2016. From Insel, T. R., and B. N. Cuthbert. 2015. Brain disorders? Precisely. Science 348(6234):499–500. Reprinted with permission from American Association for the Advancement of Science.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

BETTER DISEASE MODELS

Clinical trials in psychiatry are typically built around the DSM criteria, using neuropsychological tests as secondary outcome measures. Bilder suggested that classical psychometric tools (e.g., item response theory and computer adaptive testing) can be used in new ways. He suggested going beyond the psychometric model and for the field to consider causal models. For example, the classical psychometric explanation of depression assumes that there is an entity, major depression, which causes depressive symptoms, weight gain, sleep disturbances, etc. A network or causal modeling approach, by contrast, posits that depression results from the causal interplay among symptoms (Borsboom and Cramer, 2013). It also incorporates the concept of the progression of symptoms over time. Thus, chronic stress leads to depressed mood, which leads to self-reproach, which leads to insomnia, which leads to fatigue, which leads to problems with concentration. Bilder described a network model, built on data from more than 3,000 participants being treated for depression, that identified 28 interconnected nodes, including both DSM and non-DSM symptoms (Fried et al., 2016) (see Figure 3-2).

Biological validity is what Bilder called the “holy grail” of drug development, and viewing the multidimensionality of diseases is one step in that direction. Recent research has begun to demonstrate large genetic correlations where both diagnostic categories and dimensions, or symptoms within categories, have shared genetic contributions (see Kendler et al., 2011; Lahey et al., 2011). Population-based studies also show great overlap, implying shared genetic plus environmental contributions; this pattern of associations is not limited to psychiatric syndromes. An analysis of associations between psychiatric disorders with other medical conditions culled from 1.5 million patient records showed an increased risk of nearly every psychiatric disorder with every other medical disorder, suggesting significant shared genetic variation (Rzhetsky et al., 2007).

Thus, Bilder advocated for the use of dimensions and clusters of categories as treatment targets, as well as focusing on subgroups not only within disorders, but across syndromal boundaries. He pointed to a recent study investigating the genetic basis of major depressive disorder (MDD) in a population of Han Chinese women. By focusing on a subpopulation of women who had a particularly severe form of melancholic depression, the investigators were able to identify two genetic loci for MDD (Cai et al., 2015). Bilder also pointed to the need for validated biomarkers and explication of intermediate phenotypes to flesh out these cross-level links.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Image
FIGURE 3-2 A network model of depression.
NOTE: A: Network containing 28 of the Inventory for Depressive SymptomatologyClinician (IDS-C) depression symptoms. Green lines represent positive associations, red lines negative ones, and the thickness and brightness of an edge indicate the association strength. The layout is based on the Fruchterman–Reingold algorithm that places the nodes with stronger and/or more connections closer together and the most central nodes into the center. B: Node strength centrality estimates of the 28 IDS-C depression symptoms, including 95 percent confidence intervals.

Short codes: agi = psychomotor agitation; anx = anxious/tense; app = appetite change; bla = self-blame/worthless; con = concentration/decisions; ene = energy loss; gas = gastrointestinal problems; hyp = hypersomnia; in1 = early insomnia; in2 = mid insomnia; in3 = late insomnia; inp = interpersonal sensitivity; int = interest loss; irr = irritability; pan = panic/phobia; par = paralysis; pes = pessimism; ple = pleasure loss; qua = mood quality; rea = mood reactivity; ret = psychomotor retardation; sad = sadness; sex = loss of sexual interest; som = somatic complaints; sui = suicidal ideation; sym = sympathetic arousal; var = diurnal variation; wei = weight change.

SOURCES: Presented by Robert Bilder at the Workshop on Neuroscience Trials of the Future, March 3, 2016. Reprinted from the Journal of Affective Disorders, 189, Fried, E. I., S. Epskamp, R. M. Nesse, F. Tuerlinckx, and D. Borsboom, What are “good” depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis, 314–320, Copyright (2016), with permission from Elsevier.
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

There has also been a great deal of interest in leveraging and using genetic models to facilitate stratification of patients and validate targets, said Perry Nisen. However, he reminded workshop participants that association and causality are not the same; connecting a gene or mutation at a biological level to a disease process is critical. Similarly, he urged caution in interpreting cellular and animal models without a thorough understanding of the underlying biology of the disease.

BIOMARKERS

Biomarkers, defined as characteristics that can be objectively measured and evaluated as indicators of biological processes (Biomarkers Definitions Working Group, 2001), have become essential across different phases of drug development. They are typically categorized as diagnostic, prognostic, predictive, disease progression, or pharmacodynamic, according to their intended use. For example, pharmacodynamic biomarkers may be used in early-stage drug development to demonstrate target engagement, while in later stages, prognostic or predictive biomarkers may be used to stratify participants in a clinical trial or demonstrate treatment response.

Throughout the workshop, several participants expressed the need for more validated biomarkers in the field. In a recent systematic review examining published articles on biomarkers in psychosis since 2012, of 3,200 articles, the authors found that most of the biomarkers were diagnostic, with limited utility for precision medicine studies (Prata et al., 2014). Of the 257 potentially useful prognostic, predictive, or monitoring biomarkers studied, only one had both a reasonable effect size and high quality of evidence, yet even that one had sensitivity of only 21 percent, not enough to change clinical care. According to Shitij Kapur, this study illustrated several problems that plague the biomedical, including the neuroscience, literature: publication bias, lack of replication, or “approximate” replication (i.e., replication studies that use different measures and modalities [see Van Snellenberg et al., 2006]); insufficiently powered studies (Button et al., 2013); and insufficient attention to clinical significance (e.g., Levine et al., 2015).

Anil Malhotra, director of psychiatry research at Zucker Hillside Hospital and professor of molecular medicine and psychiatry at Hofstra Northwell School of Medicine at Hofstra University, illustrated the need for biomarkers using a recent trial that compared the efficacy of acute

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

treatment with aripiprazole2 and risperidone3 for first episode schizophrenia and related disorders (Robinson et al., 2015). The researchers examined the change in psychotic symptoms over 3 months, but despite the relatively large number of participants in the trial (198 patients), no difference was seen. Interestingly, however, there was significant variance in response. If it were possible to identify in advance who was likely to benefit from a specific treatment through the use of biomarkers, it might be possible to achieve greater power with smaller studies, said Malhotra.

He described some of the advantages and disadvantages of genetic and neuroimaging biomarkers for psychiatric disorders, noting, however, that there are many other types of biomarkers, including biochemical markers from the cerebrospinal fluid (CSF) and plasma, cognitive and neuropsychological measures, among others. With regard to plasma metabolites, although they are popular because of the relatively easy access, so far it has been very difficult to extrapolate from the plasma to the brain, said Malhotra.

Advantages of genetic biomarkers include the ease of access to DNA from blood or saliva and the stability of genotype over time, meaning you can collect samples after a trial for a prospective analysis. Disadvantages primarily relate to power: the sample sizes of most genetic studies are quite large. Neuroimaging biomarkers also have both advantages and disadvantages, said Malhotra. The most notable advantage is the ability to directly assess brain structure and function, including the ability to assess specific regions and circuits within the brain. Disadvantages include the difficulty of precise replication, potential confounds from environmental factors such as prior treatment, and subject acceptance. Moreover, it is not always clear what is being measured, he said. Many different neuroimaging modalities may yield potential biomarkers, including structural magnetic resonance imaging (MRI), diffusion tensor imaging (DTI), task-based functional MRI (fMRI), and resting-state fMRI (see Table 3-2).

Resting-state fMRI has shown particular promise in providing a good signal and also is one of the easier measures to access, said Malhotra. It provides a measure of brain activity in the absence of an externally prompted task as a means of defining functional networks. It also enables

___________________

2 Aripiprazole is an atypical antipsychotic, used primarily to treat schizophrenia and bipolar disorder.

3 Risperidone is an antipsychotic used primarily to treat schizophrenia, bipolar disorder, and behavior problems.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

TABLE 3-2 Neuroimaging Approaches to the Heterogeneity of Anti-psychotic Response

Modality Characteristic Measured
Structural CT or MRI

Assessment of morphology

Diffusion tensor imaging

Putative measure of white-matter integrity

Task-based fMRI

Change in BOLD signal during conduct of a cognitive/behavioral/emotional activation task

Resting-state fMRI

Correlation in BOLD signal during “rest”

NOTE: BOLD signal = blood-oxygen-level‒dependent changes, induced by blood flow; CT = computerized tomography; MRI = magnetic resonance imaging.

SOURCE: Presented by Anil Malhotra at the Workshop on Neuroscience Trials of the Future, March 3, 2016.

investigators to assess the functional connectivity among multiple regions of the brain. For example, Malhotra and colleagues showed that improvement in psychotic symptoms over 12 weeks in individuals with first episode schizophrenia correlated with increased connectivity in cortical striatal circuits, suggesting that increasing connectivity in these circuits could be used as a biomarker of antipsychotic efficacy (Sarpal et al., 2015). Indeed, in a more recent study, Malhotra’s team used baseline striatal functional connectivity to predict antipsychotic drug response (Sarpal et al., 2016).

The striatal connectivity index4 (SCI) has also been applied to other clinical studies, including the aripiprazole and risperidone study mentioned at the beginning of this chapter, in which no difference in efficacy was seen. Among study participants who had undergone baseline resting-state fMRI scans, responders tended to have lower SCI than non-responders, further supporting its potential as a predictive biomarker.

Several participants highlighted that biomarkers for nervous system disorders are somewhat more developed in neurology than psychiatry. For example, Story Landis, former director of the National Institute of Neurological Disorders and Stroke (NINDS), commented that the identification of neuroimaging as a biomarker for immunological disturbances transformed drug development for multiple sclerosis (MS), where there are now drugs that slow progression of the disease. However, much remains to be learned with regard to how and why these drugs work as well as on other aspects of MS, such as the neurodegenerative component.

___________________

4 An aggregate of the 91 couplets of connectivity between the striatum and the cortex, was used by the researchers to determine antipsychotic drug efficacy.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

There has been a particularly substantial effort to develop biomarkers for Alzheimer’s disease (AD), exemplified by ADNI. ADNI was launched in 2004 with the initial goal of developing imaging and biochemical biomarkers for the early detection of AD, as well as for use in clinical trials. However, the impact of ADNI on the AD field and beyond has been far broader, said Alice Chen-Plotkin, assistant professor of neurology at the Perelman School of Medicine, University of Pennsylvania. It set a precedent for open data sharing in the neurodegenerative disease space and demonstrated the potential benefits of bringing together experts from industry, governmental agencies, academia, and private foundations to provide the funds required to address a monumental problem (Weiner et al., 2015).

The original ADNI cohort consisted of 200 normal controls, 200 people with overt AD, and 400 people with amnestic mild cognitive impairment (aMCI), which was thought to possibly represent prodromal AD. Study participants were assessed clinically and with biomarker studies at 6-month intervals for 4 years. Following the initial 5-year study, additional funding was obtained in 2009 with a Grand Opportunities grant (ADNI-GO) and in 2011 with a renewal (ADNI-2), enabling an additional 550 people to be enrolled and the focus to shift to earlier phases of the disease.

Since its inception, data from ADNI have resulted in more than 600 publications (Weiner et al., 2015) that have transformed the understanding of AD. Chen-Plotkin summarized some of the learnings from ADNI:

  • Biochemical biomarkers in the CSF can discriminate individuals with aMCI who will go on to develop AD from those who will not (Shaw et al., 2009).
  • Positron emission tomography (PET) scans using ligands that bind to beta amyloid (Aβ, the protein found in the amyloid plaques seen at autopsy) can demonstrate the deposition of amyloid in the brain in vivo (Clark et al., 2011).
  • These measurements are meaningful if one knows the quantitation is accurate and can be reproduced in any lab that follows the standardized procedure.

ADNI has already led to changes in how AD trials are conducted, said Chen-Plotkin. Phase III trials are being conducted in preclinical stages of AD using amyloid imaging and CSF biomarkers as entry criteria to enrich for patients on the AD trajectory. Biomarkers are also cur-

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

rently being incorporated into diagnostic criteria in the research settings, but may be used for clinical diagnosis in the future (Sperling et al., 2011).

Identifying biomarkers to expedite clinical trials in Parkinson’s disease (PD) has proved to be more difficult, said Chen-Plotkin. Although both AD and PD are characterized by misfolding and aggregation of a central culprit molecule—Aβ in AD and α-synuclein in PD—no specific imaging ligand for α-synuclein has been identified, and levels of α-synuclein in CSF are not predictive of disease progression (Kang et al., 2013). Chen-Plotkin, along with other PD researchers, think an unbiased screening approach, made possible by advances in genomics and proteomics, will be needed to identify predictive biomarkers for PD (Chen-Plotkin, 2014). The PD community (e.g., researchers and patient advocacy groups), like the AD community before it, now is organizing around a pipeline for discovery, replication, and further development of novel PD biomarkers. In 2012, NINDS launched the Parkinson’s Disease Biomarker Program (PDBP), which has collected biospecimens and clinical data from more than 1,000 people, stored them in a central repository, and made them available for discovery efforts by the neuroscience research community (Rosenthal et al., 2015). Meanwhile, the Parkinson’s Progression Markers Initiative (PPMI), sponsored by the Michael J. Fox Foundation for Parkinson’s Research, has collected samples along with clinical and behavioral assessments from multiple cohorts, including normal controls and individuals with PD, as well as those in the prodromal stage of PD. These samples and data are available to the research community.

Chen-Plotkin’s group at the University of Pennsylvania was one of the first to use this pipeline. In 2013, they identified a candidate protein biomarker for PD using an unbiased screening approach on samples acquired at the university. They showed that higher plasma levels of Apolipoprotein A1 (ApoA1) were correlated with older age at PD onset and less severe PD (Qiang et al., 2013). Then, using samples from PPMI, they replicated the study, thus providing the first report of a plasma-based biomarker of disease progression in PD and suggesting that ApoA1 may represent a therapeutic target (Swanson et al., 2015).

Chen-Plotkin and colleagues were also interested in replicating a study that suggested that low levels of epidermal growth factor in the blood were predictive of which PD patients would become demented. However, they observed substantial site-to-site variability in the measurement of epidermal growth factor at PPMI sites, highlighting the need for strict adherence to standardized protocols.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

Moreover, there are gaps in our knowledge about biomarkers, which need to be overcome, said Bilder. For example, in a study of the association of amyloid burden with disruption of the default mode network, neither of these measures were associated with cognitive impairment (Hedden et al., 2009). In addition, several participants noted that there is a great need for biomarkers with predictive power. This will likely require a multimodal approach rather than a single determinant biomarker, said Malhotra. Luca Pani, director general of the Italian Medicines Agency (AIFA), said biomarkers are also needed to show that a treatment makes sense in terms of value. For example, if a biomarker could predict that a specific treatment for hepatitis C reduces the need for transplantation in some patients, the savings could influence the approval decision. The predictive biomarkers (diagnostic) in oncology play a critical role in understanding molecular and cellular mechanisms, which drive tumor initiation, maintenance and progression. They help to optimize therapy decisions, as they provide information on the likelihood of response to a given chemotherapeutic. However, he noted that this would be more difficult for psychiatry and neurology area.

Chen-Plotkin and S. Kapur emphasized the need for building international consortia and public–private partnerships to advance the development of new tools. For example, an international consortium called Novel Methods leading to New Medications in Depression and Schizophrenia (NEWMEDS) has developed a tool called a clinical significance calculator to help investigators estimate whether a predictive biomarker for depression is likely to demonstrate clinical significance, shifting attention away from a focus on statistical significance, or p-values (Uher et al., 2012), said S. Kapur. In addition, Chen-Plotkin noted that biorepositories and sharing of biospecimens will enable the more efficient development of a wide range of biomarkers.

CLINICALLY MEANINGFUL OUTCOMES

In recent years, regulators and payers have increasingly required that clinical studies demonstrate not only statistical significance of an effect, but even more importantly, clinical significance (Ranganathan et al., 2015). This view was also reflected in comments from many workshop participants. The bottom line, said Romano, is that no payer will provide coverage for a product that does not show clinical relevance. Studies need to show that a difference is relevant not against placebo, but against

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

comparators, he added. S. Kapur noted that effect size is not the same as clinical significance. He further proposed developing a framework for assessing the clinical significance of potential innovative options that will make health care cheaper, not just “flashier” and stratified.

Clinically relevant endpoints are also important to promote clinical implementation. Publication in an appropriate peer-reviewed journal provides an avenue for acceptance by the community, yet an analysis of randomized clinical trials supported by the National Heart, Lung, and Blood Institute showed that only 57 percent of studies were published within 30 months of completion of the trial. However, those trials with clinical endpoints were published significantly sooner than those with surrogate endpoints (Gordon et al., 2013), noted Adrian Felipe Hernandez, professor of medicine at the Duke University School of Medicine.

NOVEL CLINICAL TRIAL DESIGNS

Statistical Approaches and Considerations

Many design and methodology approaches can increase trial efficiency, said Michael Pencina, director of biostatistics at the Duke Clinical Research Institute and professor of biostatistics and bioinformatics at Duke University. In general, he said, regulatory bodies are most open to innovative clinical trial designs in smaller studies and in earlier stages of drug development. The design has to be fit-for-purpose, and appropriate statistical expertise is needed in the planning stage. He gave a brief overview of the various design choices:

  • Event-driven trials are appropriate if an outcome can be measured over time and the duration of the trial is sufficient to enable an adequate number of events to be observed. In contrast to more traditional studies where participants are followed for a specific period of time, time-to-event studies can be stopped when an adequate number of outcomes are achieved, and all follow-up is included in the analysis. Efficiency can be further maximized by blinded interim monitoring of event counts, followed by increasing or decreasing the planned study duration, or increasing the sample size.
  • Composite outcomes, used extensively in cardiology studies, may also increase the efficiency of a study, particularly if there
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
  • are multiple outcomes that are roughly similar in severity. The composite itself may provide increased power, while analysis of individual components may bring added value. Hierarchical composites combine outcomes of varying severity. In this case, the most severe outcome (e.g., death) is used as the first comparator; if this outcome fails to materialize, the next most severe outcome (e.g., hospitalization) could be analyzed, etc. Continuous outcomes make this method more powerful.

  • Adaptive designs, in which a key study feature, such as sample size, duration, or number of treatment arms, can be modified and adapted based on an interim analysis. One example is a “drop-the-losers” design, where treatment arms are dropped if they fail to meet a prescribed threshold, while those that meet this threshold are advanced to the next stage.
  • Enrichment designs typically use biomarkers to ensure a more homogeneous and likely-to-respond study population. Adaptive enrichment designs adapt based on a biomarker. For example, different arms could include participants with different genetic markers. Following interim analysis those arms showing greater effect sizes could be enriched.
  • Sequential parallel comparison designs are used to reduce the impact of the placebo response. In the first stage of such a design, participants may be randomized to receive treatment or placebo; in the second stage, placebo non-responders are re-randomized. The final summary statistic in this type of trial is then based on a weighted combination of effects from the two stages.
  • Controls may sometimes be borrowed from historical information, using several different methods. The simplest, yet controversial, approach is to pool historical information with randomized controls. If there is enough homogeneity among the studies, this can substantially reduce sample size. Historical information may also be used to define performance criterion by enabling derivation of an estimated event rate that the treatment being tested must exceed. Another more sophisticated approach involves testing first to see if controls are sufficiently similar for pooling. Even more sophisticated approaches allow investigators to model variations between current and historical data to enable their use.
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

2×2 Blind Trial Design

Erik Snowberg, professor of economics and political science at the California Institute of Technology, proposed a novel design, which he developed with his colleague Sylvain Chassang, professor of economics and public affairs at Princeton University. Their design leverages the observation that dropouts decline when participants have a greater likelihood of receiving treatment, and capitalizes on the “placebo effect.” In the biomedical world, placebo implies a sham treatment; however, economists equate placebo effects with behaviors, which can interact with treatment and affect the efficacy of a treatment. For example, participants who believe they are receiving treatment for depression may change their behavior with the thought that because they are being treated, they will be able to more successfully navigate social situations. Interacting with others may then help alleviate their depression, and the behavior thus influences the treatment effect.

Clinical trials that allocate participants equally to the treatment and placebo arms are typically suboptimally powered, said Snowberg, in part because of the high rate of dropouts. More power can be achieved by randomizing more participants to the treatment arm. This not only reduces dropouts, but changes behavior, because participants believe they have a higher likelihood of receiving treatment. Moreover, it allows investigators to assess the benefit from the interaction of behavior and treatment.

Snowberg and Chassang tested this theory using participant-level data collected by Fournier and colleagues (2010) in a meta-analysis of double-blind RCTs for depression. Data from six trials (three trials each for imipramine5 and paroxetine6) were selected. Among the imipramine trials, two allocated participants equally and one allocated 70 percent to receive treatment. Among the paroxetine trials, one allocated equally and the other two allocated 65 percent and 67 percent to receive treatment. Their analysis showed that treatment probability affected participants’ decision to drop out of a trial, and that for paroxetine, but not imipramine, there was an interaction between treatment and behavior that resulted in an improved treatment effect (Chassang et al., 2015).

With the 2×2 blind trial that Snowberg and Chassang propose (see Figure 3-3), the aggregate probability of treatment is 50 percent, but the

___________________

5 Imipramine is a tricyclic antidepressant used primarily to treat major depressive disorder.

6 Paroxetine is a selective serotonin reuptake inhibitor (SSRI) used to treat major depressive disorder and other psychiatric disorders.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Image
FIGURE 3-3 2×2 blind trial design.
SOURCES: Presented by Erik Snowberg at the Workshop on Neuroscience Trials of the Future, March 3, 2016, from Chassang et al., 2015.

different groups allow the investigator to decompose the treatment effect into three parts: the effect of behavior, the effect of the treatment itself, and the interaction of behavior and treatment. Participants are first randomized into two groups: a high probability (75 percent) of treatment group and a low probability (25 percent) of treatment group. Participants are informed of their probability of treatment, and the trials are run in a blinded fashion in the usual way, with a combined analysis of the two groups. Snowberg said this approach in Phase II provides investigators with information that will enable them to conduct more optimally powered Phase III studies.

The Established Status Epilepticus Trial

Jaideep Kapur, Eugene Meyer III professor of neuroscience and neurology at the University of Virginia School of Medicine, described another novel trial design that is being used to identify the best way of treating benzodiazepine-refractory status epilepticus. The Established Status Epilepticus Trial (ESETT) was designed to identify the best treatment for the 35 to 45 percent of patients who do not respond to benzodiazepines, the standard first line agent for treatment of status epilepticus. There has been a lack of well-controlled studies for this indication, and treatment practices vary. In the United States, the most commonly used drug is fosphenytoin; however, a newer drug, levetiracetam, is easier to use and has fewer side effects, yet evidence from uncontrolled studies in Europe, India, and other places suggest that valproic acid is superior, said J. Kapur. The ESETT investigators have therefore designed a comparative efficacy trial to determine which drug is best (Bleck et al., 2013).

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

The trial, which is being conducted at 51 sites, has several unique characteristics. Recruitment is conducted by emergency department physicians from patients who are transported to the study sites and received benzodiazepines en route by emergency medical personnel. If a patient continues to seize and meets the inclusion criteria, the physician administers the study drug, which has been provided in prerandomized, blinded study boxes. The outcome is absence of seizures and regaining of consciousness at 60 minutes. J. Kapur noted that randomization will also be stratified into three age groups: 2–18 years, 19–65 years, and 66 years or older.

The second important feature of ESETT is a Bayesian adaptive design. In designing this trial, investigators ran thousands of simulations based on several different scenarios (e.g., different effect sizes and false-positive rates for the three compounds), which enabled them to select the optimal operating characteristics (e.g., timing of analyses, power, sample size, etc.) with adequate power and a minimum sample size (Connor et al., 2013). The design they selected will start by first enrolling 300 patients, allocated equally to each of the three drugs. After an interim analysis, allocation ratios will be modified based on performance, such that the best performing drug will get more patients and the worst performing drug will get fewer. This type of design ensures that the most effective drug will be given to the largest proportion of patients. J. Kapur noted that the trial will be stopped early for efficacy (one treatment clearly better) or futility (either all arms are bad or the trial appears unlikely to identify a best and worst treatment). He added that it will be finished and considered a success when the probability that one treatment is the most effective exceeds 0.975. The trial has been funded for 795 patients, but the investigators hope to have an answer and finish early.

LESSONS LEARNED FROM OTHER THERAPEUTIC AREAS

Successful drug development in other disease areas such as oncology and cardiology may provide insight for neurology and psychiatry. For example, a major advance in the treatment of melanoma required the development of a targeted regimen for melanomas resistant to therapy. This regimen uses two drugs that inhibit different cell-signaling molecules, and was made possible by leveraging genetic data to facilitate the stratification of patients, which enabled validation of targets, according to Nisen. Researchers had first discovered the mechanisms of resistance to one

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

type of inhibitor and then proceeded to design a study that demonstrated the efficacy of combined treatment with drugs that inhibit two different cell-signaling molecules (Flaherty et al., 2012; Wagle et al., 2011).

One of the important lessons from this effort, said Nisen, is that in addition to having a validated mechanism and a way of assessing an early signal, combining therapeutics at the earliest stages of drug development should be considered for disorders that are heterogeneous and multifactorial. In addition, while the conventional wisdom is that studies should be kept as simple as possible, Nisen said this study was extremely complicated and very adaptive, but enabled the investigators to answer fundamental questions about dose, drug‒drug interactions, pharmacokinetics, safety and tolerability, and clinical activity.

Another important lesson from oncology relates to the establishment of Comprehensive Cancer Centers, which provide improved integration between basic science and the clinical enterprise. According to Nisen, about 90 percent of children with cancer participate in clinical trials at these centers, with high cure rates for certain types of cancer (e.g., most childhood acute lymphoblasic leukemia is cured). Adults with cancer are much less likely to be treated at one of these centers, and less than 5 percent participate in trials. The survival rate for all adults is much lower.

Cardiology provides additional lessons applicable to neuroscience trials of the future. The cardiology field has a relatively strong evidence base upon which treatment guidelines have been developed. Nonetheless, a cultural demand there remains within the cardiology community to fill in the knowledge gaps, according to Hernandez. Thus, networks of cardiologists have collaborated to develop large, multicenter randomized studies. For example, the Global Utilization of Streptokinase and t-PA for Occluded Coronary Arteries (GUSTO) study enrolled more than 40,000 patients at more than 1,000 hospitals in 15 countries despite the required completion of a three-page case report form for each patient (GUSTO Investigators, 1993). Key to harnessing the community’s interest is asking a relevant question, said Hernandez. For example, the drug neseritide was approved in 2001 for acute heart failure with a pivotal study of fewer than 500 patients. Widespread use, however, indicated that the drug was associated with acute adverse effects. This led to the creation of the Acute Study of Clinical Effectiveness of Nesiritide and Decompensated Heart Failure (Hernandez et al., 2009), a large pragmatic trial focused on understanding clinically meaningful outcomes in the context of real-world use. Despite the negative press about nesiritide, the cardiology community came together and successfully enrolled more

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

than 3,000 participants, exceeding its projected enrollment. Now, the cardiology community is moving forward with a large-scale (20,000 participants), pragmatic, adaptable, patient-centric, randomized controlled trial (RCT) using the National Patient-Centered Clinical Research Network (PCORnet). This study will leverage data from electronic health records and collect patient-reported information electronically through patient portals.

Another lesson learned from cardiology studies is the importance of making sure the background therapy is relevant to the market. For example, in a study of ticagrelor,7 outcomes in North America were substantially poorer than those in other parts of the world (Wallentin et al., 2009). A post-hoc study identified the reason: A different dose of aspirin being used as an antiplatelet background therapy, said Hernandez. He added that selecting the appropriate outcome measure for the trial is also important.

In addition, a new paradigm that has emerged from cardiology is the registry-based randomized clinical trial (Lauer and D’Agostino, 2013), which the authors of the study called “the next disruptive technology in clinical research,” said Hernandez. This approach leveraged clinical information collected by a preexisting observational registry to identify potential participants, which markedly accelerated enrollment and eliminated the need for lengthy case report forms (CRFs). Pencina noted that electronic health records and registry-enabled trials may also be useful in allowing investigators to run very large, simple trials for a fraction of the cost of more typical trials.

Finally, a few participants noted that value of trials in which patients serve as their control (also known as N of 1). Although not frequently used for trials for nervous system disorders, N of 1 trials may lead to more individualized treatment (Lillie et al., 2011).

DEVELOPING MORE EFFECTIVE THERAPEUTICS THROUGH PRECISION MEDICINE: IMPLICATIONS FOR CLINICAL TRIALS

Opportunities may also emerge from examination of success in other fields, said Shitij Kapur, executive dean and head of school at the Institute of Psychiatry, Psychology & Neuroscience, King’s College London. In oncology, precision medicine has emerged as a valuable and innova-

___________________

7 Ticagrelor is a platelet aggregate inhibitor used to prevent strokes and heart attacks.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

tive approach for treating some of the most intractable types of cancer; many of the advances are found in the treatment of breast cancer. Today, nearly all newly diagnosed breast cancers are tested for the presence of the human epidermal growth factor receptor (HER2/neu).

These efforts in the breast cancer field highlight the need for patience and persistence, said S. Kapur. Two recent papers show that following the principles of personalized medicine double the chances of success (Cook et al., 2014; Nelson et al., 2015). However, the movement toward personalized medicine has not yet resulted in precision medicine trials in nervous system disorders despite a few promising leads (Liu et al., 2012; Volpi et al., 2009).

S. Kapur predicted that precision medicine in neurology and psychiatry will enrich and modify rather than replace current practice, presenting both challenges and opportunities for clinical trial design. Specifically, he noted that developing biomarkers that predict disease progression and treatment response longitudinally is needed for nervous system disorders. Several participants added that using multimodal approaches rather than a single approach may help to show which drugs or other intervention approaches work best for which patients. In addition, using big data approaches may help to identify correlations among diverse types of patient data and outcomes. Robert Califf emphasized that recruiting as many volunteers as possible to participate in research as a normal part of their patient care, through the Precision Medicine Initiative, will be important for therapeutic development (e.g., Slamon et al., 1987; Smith et al., 2007).

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×

This page intentionally left blank.

Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 15
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 16
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 17
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 18
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 19
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 20
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 21
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 22
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 23
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 24
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 25
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 26
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 27
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 28
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 29
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 30
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 31
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 32
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 33
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 34
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 35
Suggested Citation:"3 Clinical Trial Design." National Academies of Sciences, Engineering, and Medicine. 2016. Neuroscience Trials of the Future: Proceedings of a Workshop. Washington, DC: The National Academies Press. doi: 10.17226/23502.
×
Page 36
Next: 4 Transforming Clinical Trials with Technology »
Neuroscience Trials of the Future: Proceedings of a Workshop Get This Book
×
Buy Paperback | $46.00 Buy Ebook | $36.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

On March 3-4, 2016, the National Academies of Sciences, Engineering, and Medicine’s Forum on Neuroscience and Nervous System Disorders held a workshop in Washington, DC, bringing together key stakeholders to discuss opportunities for improving the integrity, efficiency, and validity of clinical trials for nervous system disorders. Participants in the workshop represented a range of diverse perspectives, including individuals not normally associated with traditional clinical trials. The purpose of this workshop was to generate discussion about not only what is feasible now, but what may be possible with the implementation of cutting-edge technologies in the future.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!