- Research article
- Open Access
Mammalian target of Rapamycin inhibition and mycobacterial survival are uncoupled in murine macrophages
© Zullo et al.; licensee BioMed Central Ltd. 2014
- Received: 16 October 2013
- Accepted: 10 February 2014
- Published: 14 February 2014
Autophagy is a cellular response to intracellular pathogens including mycobacteria and is induced by the direct inhibitors of mammalian target of Rapamycin (mTOR), a major negative regulator of autophagy. Autophagy induction by mTOR inhibition (mTOR dependent autophagy), through chemical means or starvation, leads to mycobacterial killing in infected cells. However, previous work by our group has shown that mycobacterial infection of macrophages naturally induces both autophagy and mammalian target of Rapamycin (mTOR) activity (mTOR independent autophagy). In the current work, we further explore the relationship between mTOR activity and mycobacterial killing in macrophages.
While low concentrations of the mTOR inhibitors, Rapamycin, Torin 1, and Torin 2, can effectively reduce or block mTOR activity in response to lipopolysaccharides (LPS) or mycobacteria, higher concentrations (10 uM) are required to observe Mycobacterium smegmatis killing. The growth of M. smegmatis was also inhibited by high concentrations of Rapamycin in LC3B and ATG5 deficient bone marrow derived macrophages, suggesting that non-autophagic mechanisms might contribute to killing at high doses. Since mycobacterial killing could be observed only at fairly high concentrations of the mTOR inhibitors, exceeding doses necessary to inhibit mTOR, we hypothesized that high doses of Rapamycin, the most commonly utilized mTOR inhibitor for inducing autophagic killing, may exert a direct bactericidal effect on the mycobacteria. Although a short-term treatment of mycobacteria with Rapamycin did not substantially affect mycobacterial growth, a long-term exposure to Rapamycin could impact mycobacterial growth in vitro in select species.
This data, coupled with previous work from our laboratory, further indicates that autophagy induction by mTOR inhibition is an artificial means to increase mycobacterial killing and masks more relevant endogenous autophagic biochemistry that needs to be understood.
- Bacille Calmette-Guérin (BCG)
- M. tuberculosis
The autophagy pathway was first identified as a stress response that allowed cells to survive when nutrients were scarce . Under such conditions, the lack of amino acids and other basic building blocks leads to a reduction in mTOR signaling, a critical sensor of nutrient availability . The absence of mTOR activity induces a reduction in anabolic activities such as protein synthesis, and autophagy is induced to digest unwanted cellular material and liberate building blocks that can be used to sustain survival. The induction of autophagy in response to reduced mTOR signaling due to nutrient stress is considered an mTOR dependent autophagy. More recently, it has been recognized that autophagy is a critical mechanism by which the host can control the growth of intracellular pathogens such as mycobacteria . Recognition of the invading microbe can be achieved through various mechanisms including pattern recognition receptors (NLRs, TLRs, and sequestome-like receptors), inflammatory cytokine signaling, and even antibiotic-mediated pathogen stress –. Infection of cells with various pathogens and mTOR inhibition via Rapamycin or nutrient starvation leads to the isolation of pathogens within autophagosomes via mTOR dependent autophagy. Fusion of the pathogen-containing autophagosome with a lysosome to form the autolysosome results in the direct digestion of the microbe and the liberation of antigenic epitopes used by MHC-I and MHC-II to stimulate adaptive immune responses [9, 10]. For example, infection of dendritic cells with mycobacteria followed by treatment with Rapamycin enhances antigen presentation and vaccine efficacy . Moreover, infection of mice lacking ATG5 with M. tuberculosis, a protein essential for the processing of LC3B, results in increased bacterial burdens and enhanced inflammatory responses in comparison to ATG5 expressing mice . Thus, it is essential to better understand how mycobacteria may interact with the autophagy pathway so that enhanced strategies can be designed to improve autophagy-mediated killing, minimize the risk of disease, and bolster productive immune responses.
Previous work by our laboratory has documented that mycobacterial infection naturally induces autophagy in RAW264.7 cells . mTOR induction by mycobacterial infection could be blocked by both Rapamycin treatment and nutrient starvation . However, in contrast to autophagy induced by mTOR inhibition (mTOR dependent autophagy), mycobacterial infection simultaneously induces both autophagy and mTOR signaling. This indicates that mycobacteria induce mTOR independent autophagy responses. These unexpected findings now allow for additional investigation of the relationship between mycobacteria, mTOR, and autophagy, which is the basis of our current work. Our data further supports the notion that the use of mTOR inhibition to study mycobacterial killing (mTOR-dependent autophagic killing) is non-physiologic and thus obscures endogenous biochemistry that is critical for understanding and exploiting host-pathogen interactions to favor pathogen clearance.
Characterization of mTOR inhibitors
Higher concentrations of mTOR inhibitors are required for M. smegmatis killing
Higher concentrations of Rapamycin induce M. smegmatis killing in LC3B and ATG5 deficient macrophages
M. smegmatis and BCG are not directly impacted by Rapamycin in the context of a typical autophagy assay
Long-term exposure to Rapamycin can impact the growth of some mycobacterial species
The autophagy pathway has emerged as a versatile cellular mechanism that allows mammalian cells to defend themselves from an array of intracellular microbes [7, 9]. Autophagy induction through mTOR inhibition is widely used to demonstrate the autophagic killing of a wide variety of pathogens including mycobacteria. This mTOR dependent autophagy triggers an evolutionarily conserved autophagy response that mimics nutrient deprivation. While extremely effective at inducing pathogen killing, inhibiting mTOR activity may not faithfully recapitulate the biochemistry induced during infection. This is exemplified by previous work from our laboratory demonstrating that mycobacterial infection simultaneously induces both autophagy and mTOR signaling . While largely unexpected, these initial findings now permit additional query into the relationship between mTOR inhibition and pathogen killing.
In the current work, we show that while 1 uM of the mTOR inhibitors Rapamycin, Torin 1, and Torin 2 could reduce mTOR activity, (Figure 1 and previously published), at least 10 uM of the inhibitors were required to demonstrate consistent and significant killing of M. smegmatis in RAW264.7 macrophages (Figure 2). This trend of higher concentrations of mTOR inhibitors being required for observable mycobacterial killing appears to exist for both allosteric (Rapamycin) and active site inhibitors (Torin 1 and Torin 2) of mTOR. This is an unexpected result as M. smegmatis infection naturally induces substantial autophagy responses such that the kinetic balance should favor killing at lower levels of mTOR inhibition . These findings inspired us to ask if the mycobacterial killing observed with high doses of Rapamycin can occur in macrophages devoid of canonical autophagy components. Using LC3B and ATG5 deficient BMDMs that lack the structural formation of autophagosomes, we showed that 25 uM and 50 uM Rapamycin act through an unappreciated mechanism to induce killing, not through LC3B or ATG5 dependent autophagy (Figure 3). Moreover, a deficiency in the autophagy pathway does not appear to alter mTOR signaling in response to mycobacterial infection. While it is certainly possible that other LC3 or ATG family members, or related signaling downstream of mTOR, could compensate when such a strong stimulus is applied, we must assume that additional autophagic and unidentified cellular responses become involved as the dose of Rapamycin increases. The prospect of additional cellular mechanisms that kill mycobacteria, and are induced upon mTOR inhibition, is an exciting possibility that warrants further investigation.
Since Rapamycin has long been known for its antibiotic properties in fungi and more recently in MAP (Mycobacterium avium subspecies paratuberculosis) , it seemed plausible that Rapamycin may have a direct impact on mycobacteria themselves at higher concentrations. As shown in Figure 4, it is unlikely that within the short time course of a standard autophagy assay that these chemicals could directly interfere with mycobacteria to preclude their viability. The observation that macrophages are required for killing indicates that one or more cellular mechanisms are required for mycobacterial killing under the short time frames and conditions of an autophagy assay. Interestingly, we did observe that certain strains of mycobacteria, such as BCG, M. kanasii, and laboratory and clinical isolates of M. tuberculosis, did have altered growth properties when exposed to Rapamycin for extended periods of time (Figure 5). While not related to autophagy per se, the data suggests there may be an unrecognized inhibitory target in mycobacteria that exhibits sensitivity to Rapamycin. Additional work in this area will seek to identify this target, utilizing Rapamycin as a foundation, in an effort to design more mycobacterium specific compounds.
Throughout this study we utilized the phosphorylation of ribosomal S6 protein (P-S6) as the indicator of mTOR activity in our assays. While this is a well-known and highly bona fide mTOR target that has been widely utilized as a measure of mTOR activity [13, 25], we cannot rule out that other, and perhaps unknown, mTOR targets are better correlates of mycobacterial killing in autophagy assays that utilize mTOR inhibition. This is an exciting idea, since it suggests that there are unrecognized mTOR targets that have a direct connection to mycobacterial infection whose activity is not altered by lower levels of mTOR inhibitors. Proteomics approaches will be required to take an unbiased approach to this question and identify the full spectrum of mTOR targets that are impacted by mycobacterial infection in the presence and absence of various concentrations of mTOR inhibitors.
The use of mTOR inhibitors to induce mTOR dependent autophagic pathogen killing has become the gold-standard assay within the autophagy field. This is somewhat counterintuitive given that nutrient sensing and pathogen sensing utilize unique, and presumably non-overlapping, biochemical mechanisms to affect stimulus specific responses. Taken in sum, our current work strongly suggests that the use of mTOR dependent autophagy to study mycobacterial killing (and possibly other pathogen killing) is artificial and casts shadows on the endogenous host-pathogen biochemistry that naturally occurs during infection. This is consistent with our previous studies indicating that mycobacteria induce mTOR independent autophagy during infection. Future efforts on our part will continue to study mycobacterial autophagy in the absence of artificial influences/inducers to identify specific biochemical events that can be exploited to bolster host defenses. This could be accomplished by a number of methodologies including: proteomics approaches that identify specific post-translational modifications induced shortly after mycobacterial infection; the identification of mycobacterial transposon mutants that are susceptible to macrophage autophagy; the continued use of newly created mouse model systems that are more or less susceptible to mycobacterial infection; and the identification of pharmacological agents that induce autophagy and mycobacterial killing without inhibiting the immunologically sensitive mTOR pathway. Lastly, while mTOR inhibition does carry with it substantial global effects on cellular metabolism, it can not be overlooked that finely tuned mTOR inhibition, especially if restricted to macrophages (alveolar for example), could provide a valuable means to favor host defense against mycobacterial infection.
While low doses of several mTOR inhibitors are sufficient to reduce mTOR signaling as measured by a reduction in phosphorylated ribosomal S6, the same doses of these compounds are incapable of eliciting robust killing of M. smegmatis. In contrast, high doses of Rapamycin, the most common mTOR inhibitor used in autophagy research, induces substantial M. smegmatis killing in wildtype macrophages and macrophages from autophagy deficient mice. As it does not appear that Rapamycin has a direct effect on mycobacteria in the short time frames of standard autophagy assays, it suggests that high dose inhibition of mTOR may be acting through an unappreciated cellular mechanism to elicit killing activity. When combined with our previous studies demonstrating that mycobacterial infection naturally induces both autophagy and mTOR signaling, this data reinforces the idea that mTOR inhibition through drugs or starvation is an artificial means of studying mycobacterial killing. We contend that the use of mTOR inhibition to study the molecular mechanisms of host-pathogen interactions is masking the relevant biochemistry that needs to be understood and exploited to favor host defense. However, additional studies further examining the connection between mycobacteria, the mTOR pathway, and host defense need to be performed, as fine-tuning mTOR activity to favor host defense without additional effects would be advantageous and could be developed as a valuable therapeutic.
Wildtype and LC3B knockout mice [20, 21] were purchased from Jackson laboratories. LysM-ATG5 mice were a generous gift from Herbert Virgin (Washington University). All mice were housed in the Duke Human Vaccine Institute Regional Biocontainment laboratory in accordance with institutional animal care and use guidelines.
Rapamycin (Sigma), Torin 1, and Torin 2, (Tocris) were dissolved in DMSO to a concentration of 10 mM, aliquoted, and stored at −20°C. Inhibitors were diluted fresh in culture media immediately before use. Lipopolysacharride (LPS) was purchased from Sigma, dissolved in DMEM, aliquoted, and stored at −20°C.
Mycobacterium bovis Bacille Calmette-Guérin (BCG) and M. smegmatis have been described previously . This study also uses a KZN drug-sensitive strain (V9124 [S]), a multidrug resistant (MDR) strain (V2475 [M]), and an extensively drug resistant (XDR) strain (TF275 [X]). All KZN strains were recovered from patients in KwaZulu-Natal province, South Africa . Unless otherwise noted, mycobacterial strains were cultured in 7H9 media containing 0.5% glycerol, 0.05% tyloxapol, and 10% OADC (Oleic Acid, Albumin, Dextrose, Catalase supplement; hereinafter termed “7H9-OADC”).
Cell culture, infection, and mycobacterial survival
Murine RAW264.7 macrophages have been described previously . Cells were cultured in DMEM supplemented with 10% heat-inactivated fetal bovine serum (HI-FBS), L-glutamine, sodium pyruvate, and non-essential amino acids. Human A549 alveolar epithelial cells were cultured in RPMI 1640 supplemented with 10% FBS, 1% sodium pyruvate, 1% HEPES and 1% of both non-essential and essential amino acids. For infections, mycobacteria growing in 7H9-OADC were washed in PBS with 0.05% tyloxapol, sonicated to minimize bacterial clumping, and adjusted to the multiplicity of infection 5 (MOI-5). RAW264.7 cells were first infected with mycobacteria, chemical inhibitors were added for the indicated periods of time, and CFU was then determined . For assays involving bone marrow derived macrophages (BMDM), the bone marrow was isolated and depleted of red blood cells. The cells were then differentiated toward the macrophage lineage with DMEM media supplemented with L929 derived culture supernatant . Infection and CFU determination were performed as described above.
The following antibodies were used in this study: anti-Actin plus anti-mouse HRP were purchased from GenScript and Anti-phospho-S6, anti-S6, and anti-rabbit-HRP were purchased from Cell Signaling. Blotting conditions and chemiluminescence have been described .
DQ-BSA assays and flow cytometry
RAW264.7 macrophages were loaded with DQ-BSA as described previously . After an overnight treatment with mTOR inhibitors, DQ-BSA was detected utilizing the PE channels of a BD FACSCanto or a BD LSRII flow cytometer. Flow cytometry was performed at both the Duke University Shared Cytometry Resource and the Yale School of Medicine Cell Sorter Facility. The data were analyzed with FlowJo software.
LC3 Immunofluorescent staining
A549 cells were cultured on glass coverslips, fixed with 4% formalin, stained with either rabbit anti-LC3B (Cell Signaling) or isotype control, and visualized with Alexa Fluor-594 conjugated anti-rabbit secondary antibodies as described . Counter-staining with Hoechst, fluorescent microscopy, and image analysis were performed as described previously [13, 28].
Analysis was performed with GraphPad Prism using an analysis of variance (ANOVA) with a Tukey post-test or Students T test. P values of p ≤ 0.05 were considered to be significant.
The authors thank Natalie Taylor and Hongjie Pan for technical assistance and mouse maintenance. We also thank Jörn Coers (Duke University Department of Molecular Genetics and Microbiology) for helpful discussions. Special thanks to Herbert Virgin for providing LysM-ATG5 mice. Additional thanks to Josephine Hoh (Yale University School of Public Health) for various resources and reagents. This work was supported by R21AI095723-01 grants to SL.
- He C, Klionsky DJ: Regulation mechanisms and signaling pathways of autophagy. Annu Rev Genet. 2009, 43: 67-93. 10.1146/annurev-genet-102808-114910.PubMedPubMed CentralView ArticleGoogle Scholar
- Zhou H, Huang S: The complexes of mammalian target of rapamycin. Curr Protein Pept Sci. 2010, 11 (6): 409-424. 10.2174/138920310791824093.PubMedPubMed CentralView ArticleGoogle Scholar
- Gutierrez MG, Master SS, Singh SB, Taylor GA, Colombo MI, Deretic V: Autophagy is a defense mechanism inhibiting BCG and Mycobacterium tuberculosis survival in infected macrophages. Cell. 2004, 119 (6): 753-766. 10.1016/j.cell.2004.11.038.PubMedView ArticleGoogle Scholar
- Deretic V: Autophagy as an innate immunity paradigm: expanding the scope and repertoire of pattern recognition receptors. Curr Opin Immunol. 2012, 24 (1): 21-31. 10.1016/j.coi.2011.10.006.PubMedPubMed CentralView ArticleGoogle Scholar
- Kim JJ, Lee HM, Shin DM, Kim W, Yuk JM, Jin HS, Lee SH, Cha GH, Kim JM, Lee ZW: Host cell autophagy activated by antibiotics is required for their effective antimycobacterial drug action. Cell Host Microbe. 2012, 11 (5): 457-468. 10.1016/j.chom.2012.03.008.PubMedView ArticleGoogle Scholar
- Zullo AJ, Lee S: Old antibiotics target TB with a new trick. Cell Host Microbe. 2012, 11 (5): 419-420. 10.1016/j.chom.2012.05.002.PubMedView ArticleGoogle Scholar
- Knodler LA, Celli J: Eating the strangers within: host control of intracellular bacteria via xenophagy. Cell Microbiol. 2011, 13 (9): 1319-1327. 10.1111/j.1462-5822.2011.01632.x.PubMedPubMed CentralView ArticleGoogle Scholar
- Liu G, Bi Y, Wang R, Wang X: Self-eating and self-defense: autophagy controls innate immunity and adaptive immunity. J Leukoc Biol. 2013, 93 (4): 511-519. 10.1189/jlb.0812389.PubMedView ArticleGoogle Scholar
- Deretic V: Autophagy in immunity and cell-autonomous defense against intracellular microbes. Immunol Rev. 2011, 240 (1): 92-104. 10.1111/j.1600-065X.2010.00995.x.PubMedPubMed CentralView ArticleGoogle Scholar
- Crotzer VL, Blum JS: Autophagy and adaptive immunity. Immunology. 2010, 131 (1): 9-17.PubMedPubMed CentralGoogle Scholar
- Jagannath C, Lindsey DR, Dhandayuthapani S, Xu Y, Hunter RL, Eissa NT: Autophagy enhances the efficacy of BCG vaccine by increasing peptide presentation in mouse dendritic cells. Nat Med. 2009, 15 (3): 267-276. 10.1038/nm.1928.PubMedView ArticleGoogle Scholar
- Castillo EF, Dekonenko A, Arko-Mensah J, Mandell MA, Dupont N, Jiang S, Delgado-Vargas M, Timmins GS, Bhattacharya D, Yang H: Autophagy protects against active tuberculosis by suppressing bacterial burden and inflammation. Proc Nat Acad Sci U S A. 2012, 109 (46): E3168-3176. 10.1073/pnas.1210500109.View ArticleGoogle Scholar
- Zullo AJ, Lee S: Mycobacterial induction of autophagy varies by species and occurs independently of mammalian target of rapamycin inhibition. J Biol Chem. 2012, 287 (16): 12668-12678. 10.1074/jbc.M111.320135.PubMedPubMed CentralView ArticleGoogle Scholar
- Guertin DA, Sabatini DM: The pharmacology of mTOR inhibition. Sci Signal. 2009, 2 (67): e24-View ArticleGoogle Scholar
- Lerena MC, Colombo MI: Mycobacterium marinum induces a marked LC3 recruitment to its containing phagosome that depends on a functional ESX-1 secretion system. Cell Microbiol. 2011, 13 (6): 814-835. 10.1111/j.1462-5822.2011.01581.x.PubMedView ArticleGoogle Scholar
- Liang C, Lee JS, Inn KS, Gack MU, Li Q, Roberts EA, Vergne I, Deretic V, Feng P, Akazawa C: Beclin1-binding UVRAG targets the class C Vps complex to coordinate autophagosome maturation and endocytic trafficking. Nat Cell Biol. 2008, 10 (7): 776-787. 10.1038/ncb1740.PubMedPubMed CentralView ArticleGoogle Scholar
- Ha SD, Ham B, Mogridge J, Saftig P, Lin S, Kim SO: Cathepsin B-mediated autophagy flux facilitates the anthrax toxin receptor 2-mediated delivery of anthrax lethal factor into the cytoplasm. J Biol Chem. 2010, 285 (3): 2120-2129. 10.1074/jbc.M109.065813.PubMedPubMed CentralView ArticleGoogle Scholar
- Tamai K, Tanaka N, Nara A, Yamamoto A, Nakagawa I, Yoshimori T, Ueno Y, Shimosegawa T, Sugamura K: Role of Hrs in maturation of autophagosomes in mammalian cells. Biochem Biophys Res Commun. 2007, 360 (4): 721-727. 10.1016/j.bbrc.2007.06.105.PubMedView ArticleGoogle Scholar
- Garcia-Martinez JM, Moran J, Clarke RG, Gray A, Cosulich SC, Chresta CM, Alessi DR: Ku-0063794 is a specific inhibitor of the mammalian target of rapamycin (mTOR). The Biochemical journal. 2009, 421 (1): 29-42. 10.1042/BJ20090489.PubMedPubMed CentralView ArticleGoogle Scholar
- Nakahira K, Haspel JA, Rathinam VA, Lee SJ, Dolinay T, Lam HC, Englert JA, Rabinovitch M, Cernadas M, Kim HP: Autophagy proteins regulate innate immune responses by inhibiting the release of mitochondrial DNA mediated by the NALP3 inflammasome. Nat Immunol. 2011, 12 (3): 222-230. 10.1038/ni.1980.PubMedPubMed CentralView ArticleGoogle Scholar
- Cann GM, Guignabert C, Ying L, Deshpande N, Bekker JM, Wang L, Zhou B, Rabinovitch M: Developmental expression of LC3alpha and beta: absence of fibronectin or autophagy phenotype in LC3beta knockout mice. Dev Dyn. 2008, 237 (1): 187-195. 10.1002/dvdy.21392.PubMedView ArticleGoogle Scholar
- Watson RO: Manzanillo PS. Cox JS: Extracellular M. tuberculosis DNA targets bacteria for autophagy by activating the host DNA-sensing pathway. Cell. 2012, 150 (4): 803-815. 10.1016/j.cell.2012.06.040.PubMedPubMed CentralView ArticleGoogle Scholar
- Ponpuak M, Davis AS, Roberts EA, Delgado MA, Dinkins C, Zhao Z, Virgin HW, Kyei GB, Johansen T, Vergne I: Delivery of cytosolic components by autophagic adaptor protein p62 endows autophagosomes with unique antimicrobial properties. Immunity. 2010, 32 (3): 329-341. 10.1016/j.immuni.2010.02.009.PubMedPubMed CentralView ArticleGoogle Scholar
- Greenstein RJ, Su L, Juste RA, Brown ST: On the action of cyclosporine A, rapamycin and tacrolimus on M. avium including subspecies paratuberculosis. PloS one. 2008, 3 (6): e2496-10.1371/journal.pone.0002496.PubMedPubMed CentralView ArticleGoogle Scholar
- Fingar DC, Salama S, Tsou C, Harlow E, Blenis J: Mammalian cell size is controlled by mTOR and its downstream targets S6K1 and 4EBP1/eIF4E. Genes Dev. 2002, 16 (12): 1472-1487. 10.1101/gad.995802.PubMedPubMed CentralView ArticleGoogle Scholar
- Ioerger TR, Koo S, No EG, Chen X, Larsen MH, Jacobs WR, Pillay M, Sturm AW, Sacchettini JC: Genome analysis of multi- and extensively-drug-resistant tuberculosis from KwaZulu-Natal. South Africa. PloS one. 2009, 4 (11): e7778-10.1371/journal.pone.0007778.PubMedPubMed CentralView ArticleGoogle Scholar
- Traver MK, Henry SC, Cantillana V, Oliver T, Hunn JP, Howard JC, Beer S, Pfeffer K, Coers J, Taylor GA: Immunity-related GTPase M (IRGM) proteins influence the localization of guanylate-binding protein 2 (GBP2) by modulating macroautophagy. J Biol Chem. 2011, 286 (35): 30471-30480. 10.1074/jbc.M111.251967.PubMedPubMed CentralView ArticleGoogle Scholar
- Zullo AJ, Michaud M, Zhang W, Grusby MJ: Identification of the small protein rich in arginine and glycine (SRAG): a newly identified nucleolar protein that can regulate cell proliferation. J Biol Chem. 2009, 284 (18): 12504-12511. 10.1074/jbc.M809436200.PubMedPubMed CentralView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.