How TMAO Fooled Us

In 2011, a group of researchers published a paper in Nature,1 linking the compound trimethylamine N-oxide (TMAO) to cardiovascular disease (CVD). Since then, TMAO’s role in the pathology of CVD has accumulated more and more evidence, convincing several skeptics along the way of its importance.

For those unfamiliar, TMAO is a metabolite produced by gut microbes from dietary substrates such as choline, betaine, and carnitine, which are all found in animal products. These dietary substrates are converted by certain microbes into the gas trimethylamine (TMA), which is then oxygenated by certain liver enzymes to form TMAO (chemical structure shown below).

We know that microbes are necessary for this process because experiments have shown that oral antibiotics suppress TMAO production, even in the presence of these dietary substrates.2 Once formed, TMAO is then transported to tissues in the body, where it accumulates, while some of it is cleared by the kidneys.

Mechanisms of TMAO

There are several mechanisms by which TMAO is believed to cause cardiovascular disease, but the main one involves higher levels of it increasing scavenger receptors in macrophages.3 More scavenger receptors increase the likelihood of these macrophages binding low-density lipoprotein (LDL) and forming foam cells, named for their… foamy appearance.

The creation of foam cells and their localization to fatty deposits in blood vessels can disrupt cholesterol influx, esterification, efflux, and promote inflammation, all increasing the risk of CVD.4 This process can be seen in the image below, taken from Tang et al.2

TMAO and Cardiovascular Disease

Several observational studies have found associations between TMAO levels and CVD risk, but more importantly, three recent systematic reviews and meta-analyses of cohort studies have also found increases in all-cause mortality and CVD events.58

If we assume, just for the sake of this discussion, that the biological mechanisms are valid and that the results of the cohort studies are not seriously plagued by stochastic error and bias (which is ironic, given how much I’ve discussed measurement error and multiplicity in nutritional epidemiology), then we may visualize our knowledge with the following causal diagram.

To recap, certain dietary substrates, found mostly in animal products, get converted into TMA by gut microbes and then into TMAO by liver enzymes, which then contribute to the production of foam cells, which when excessively localized, wreak all sorts of havoc.

This evidence has convinced many clinicians and researchers to discourage the consumption of animal products, especially red meat, a source of carnitine. Some cardiologists have even recommended that patients get their blood TMAO levels measured to predict their CVD risk, meaning these health professionals see it as a biomarker with clinical validity and utility.

In the words of Kraus (2018),9 clinical validity for a biomarker is:

How well the test measures a clinical feature of a disease, disease outcome or treatment outcome — is required to demonstrate the relevance of the test to the clinical condition as a guide to clinical decision-making.

Kraus (2018)9 describes clinical utility as,

How well the test improves patient outcomes, confirms or changes a diagnosis, determines appropriate therapy or identifies individuals at risk of a disease — is required to determine how well a test balances benefits and harms when used in patient management. A process separate from biomarker qualification governs the approval of a biomarker as a medical test.

All of these characteristics are more likely to be met if the biomarker is in the causal pathway of the disease.

So, if we assume that TMAO is in the causal pathway of CVD, that it can accurately predict CVD risk, and that reducing TMAO levels via certain interventions also lowers the risk of cardiovascular disease, then we’ve struck gold. Unfortunately, the literature on TMAO as a biomarker is preliminary and mixed.1013

However, that hasn’t stopped researchers from devising strategies to reduce TMAO formation. For example, take a look at some proposed interventions in the table below by Velasquez et al.3 While many of these may seem like low-cost interventions with minimal side effects, some are clearly not (like taking antibiotics) and this is all assuming TMAO is a valid marker in the causal pathway. So is it?

Intervention Effect
Antibiotics Decreased TMAO plasma levels
Microbiome Therapy Decreased TMA formation in the gut
Reduced L-carnitine and choline consumption Decrease TMAO level
Resveratrol Decreased TMA and TMAO plasma levels
Meldonium Reduced TMA production by the intestinal microbiota bacteria
3,3-dimethyl-1-butanol Inhibition of TMA formation through inhibition of microbial TMA lyases
FMO3 enzyme inhibition Prevented the oxidization of TMA to TMAO

Inconsistencies with TMAO

Several characteristics of TMAO conflict with known findings. For example, fish and other seafood contain some of the highest amounts of free TMAO,1416 yet several prospective studies have found these foods to be associated with positive CVD outcomes.

One possible explanation may be that these observational studies are simply unreliable and suffer from far too much measurement error ($$W_{ij}=X_{i}+ \epsilon_{ij}$$)17 and analytical flexibility.18 However, even randomized controlled crossover trials have shown that lean white fish reduces lipids that are risk factors for cardiovascular disease.19

Some have argued that the omega-3 fatty acids and other compounds in fish offset the harmful effects of TMAO, however, much of this is speculative. Those who remain skeptical of TMAO believe that it is a confounder and that it is the presence of certain microbes that contributes to the pathology of CVD, and these microbes also happen to produce TMAO.14,20 We can see this perspective visualized with the causal diagram below.

It’s difficult to truly know the role of TMAO in the pathology of CVD without a randomized trial explicitly manipulating TMAO levels and looking at clinical endpoints. Luckily, a recently published study21 with a powerful design offers us the next best thing.

Mendelian Randomization

In observational studies where the exposure is usually nonrandom, the ability to infer cause and effect tends to be limited by hidden confounders, reverse causality, measurement error, and selection bias, even with the use of complex methods that attempt to make groups as comparable as possible. However, a relatively new study design, called Mendelian randomization, offers a way to address many of these issues.22

It uses a technique developed in econometrics called instrumental variable analysis, where certain instruments, such as genes associated with the exposure, are used as proxies for exposures such as TMAO, choline, betaine, and carnitine.

In observational studies, we cannot randomly sample or assign TMAO and its precursors (practically) and look at clinical endpoints, but we can rely on the first and second laws of Mendel’s inheritance, because during cellular meiosis, alleles are randomly segregated and assorted, making it unlikely that many inherited genotypes are associated with population-level confounders.

In a Mendelian randomization study, once the instruments (certain genes) are known to be valid, they are tested for associations with the outcomes of interest, such as cardiovascular disease events. This method is powerful since random assortment deals with many of the issues that statistical methods cannot.

This is the approach that a group of researchers recently used to test the associations between TMAO, choline, betaine, and carnitine, and outcomes such as CVD events, type 2 diabetes risk, and chronic kidney disease. The researchers searched published databases of genome-wide association studies to look for genetic variants that were linked to the exposures (TMAO, choline, betaine, carnitine) in order to produce their instrument.

They selected single nucleotide polymorphisms (SNPs) that met the genome-wide association significance level (p < 0.000005), since these are more likely to be replicable.

These instruments were then tested for associations with the clinical outcomes. Sounds easy enough… or not. There are no free lunches, even in Mendelian randomization studies. In order for the instrument to be valid, it must meet certain assumptions:22

1. The association between the instrument (the genes) and the outcomes must only be through the exposure to which the genes are linked. That means if the genes/SNPs (like those that produce TMAO) affect the outcome (CVD) in other ways, the instrument is invalid.

2. The genes must truly be associated with the exposure of interest. That means the genes used in the instrument must truly explain a portion of the variance in the exposures (such as choline, betaine, carnitine, and TMAO).

3. The genes cannot be associated with unmeasured confounders that are associated with the exposure and the outcome.

These assumptions can be seen below, an image taken from the original paper.21

The researchers made sure their genetic variants met these assumptions by looking at the strength of the associations between the genetic variants and the metabolites and selected independent SNPs with the strongest associations (lowest P-value) for each variant. The drawback of this approach is that it can also weaken the instruments since there are bound to be SNPs with lower test statistics that can still explain a notable amount of variance. The authors explain how much metabolite variance is explained by their selected SNPs,

Our genetic analysis showed that 15.4% of betaine, 17.1% of carnitine, 8.0% of choline, and 9.6% of TMAO were explained by its SNPs.

The authors set their alpha level at P ≤ 0.0005 (0.05/100) after Bonferroni correction for multiple comparisons and took results ≤ 0.05 as suggestive of an association. They conducted an apriori power analysis with an alpha level of 0.05, to detect at least a 30% increase in the odds of cardiometabolic events for the dietary substrates and metabolites.

MR power calculation (http://cnsgenomics.com/shiny/mRnd) showed that we have 87%, 84%, 78%, 81% power to test significant (P<0.05) causal effect (OR=1.3) of betaine, carnitine, choline, and TMAO on cardiometabolic events, respectively.

As I’ve discussed in previous posts, statistical power and statistical significance hold less weight in most observational studies because there is no random mechanism. From Greenland (1990)23

Randomization provides the key link between inferential statistics and causal parameters. Inferential statistics, such as P values, confidence intervals, and likelihood ratios, have very limited meaning in causal analysis when the mechanism of exposure assignment is largely unknown or is known to be nonrandom. It is my impression that such statistics are often given a weight of authority appropriate only in randomized studies

However, because there is a random process here (random assortment of alleles during meiosis), the authors are justified in testing statistical hypotheses and focusing on power and significance. Of course, this is not encouragement for making mindless dichotomous decisions without looking at all of the data.

Results

For genetically predicted higher TMAO, none of the associations with cardiometabolic outcomes were statistically significant. Although for chronic kidney disease and myocardial infarction, there were small increases in the odds (8%) and the interval estimates were quite wide, with increases in odds as high as 60% and 99% for mycardial infarction and chronic kidney disease, respectively, being compatible with the data.

For genetically predicted choline, there was an 84% increase in the odds of type 2 diabetes 1.84, (95% CI: 1.00, 3.42) (P = 0.05) and for betaine, there was a 32% decrease in the odds of type 2 diabetes 0.68 (95% CI: 0.48, 0.95) (P = 0.023).

Because this study was a bidirectional mendelian randomization study, the authors were able to use instruments for the exposures and the outcomes to assess causal effects in both directions. A figure of what this generally looks like is shown below, taken from Haycock et al.22

They summarize their findings,

We further examined the causal effects of cardiometabolic diseases on gut dependent metabolites. We found that T2DM was causally associated with lower betaine (beta: -0.111, SE: 0.035, P=0.002) and higher TMAO levels (0.13±0.036, P<0.0001) per each 1 unit higher log odds. CKD was also causally associated with higher TMAO levels (0.483±0.168, P=0.004) per each 1 unit higher log odds.

This makes sense since TMAO levels are maintained by the kidney and chronic kidney disease would lead to higher levels of TMAO in the blood. So, although previous studies often found associations, the direction of the relationship (drawn below) was in the opposite one.

Although this study provides compelling, contradictory data, its conclusions are also limited by some methodological choices. For example, the authors chose to use the genome-wide significance level (P < 0.000005) to choose SNPs that were associated with the exposures, which would’ve lead to weaker instruments that could’ve biased the associations towards the null.

Burgess & Thompson, 2011 describe this elegantly in their Statistics in Medicine paper,24

A ‘weak instrument’ is defined as an instrument for which the statistical evidence of association with the phenotype (X) is not strong [8]. An instrument can be weak if it explains a small amount of the variation of the phenotype, where the amount defined as ‘small’ depends on the sample size. The F statistic in the first stage regression of X on G is usually quoted as a measure of the strength of an instrument [12].

Although IV methods are asymptotically unbiased, they demonstrate systematic finite sample bias. This bias, known as ‘weak instrument bias’, is in the direction of the confounded observational association between phenotype and outcome, and depends on the strength of the instrument [13]. Weak instruments are also associated with underestimated confidence intervals and poor coverage properties [14].

A generally quoted criterion is that an instrument is weak if the F statistic in the G–X regression is less than 10 [8, 15]. However, using instruments with F>10 only reduces bias to less than a certain level, and problems with weak instrument bias still occur [12].

They provide practical recommendations:

We conclude with the following advice to practitioners:

• Genetic instruments used in Mendelian randomization studies should be pre-specified prior to data collection and analysis. The underlying IV assumptions should be tested carefully, as far as possible.

• Sample sizes should be chosen where possible to ensure that the expected value of F is greater than 10. F statistics should be quoted when reporting study results, but F statistics or other measures of instrument strength in the data should not determine the analysis used.

• Where there are potential problems with weak instruments, results should be assessed for bias by sensitivity analyses, using various assumptions in the model for genetic association and methods of IV analysis such as LIML.

Despite these limitations, the study showed that there were very small associations between the exposures of interest and the clinical outcomes, which have often been large in nearly every cohort study, likely due to confounding. Furthermore, the study found that type 2 diabetes and chronic renal disease were causally associated with TMAO levels, adressing the problem of reverse causality encountered by previous cohort studies.

Results like this make it apparent how difficult it is to determine the nature of dietary-health relationships. Although there are valid mechanisms by which TMAO could contribute to cardiometabolic diseases, there are several other confounding mechanisms that may explain away the associations between the exposure and the outcome. In the absence of random mechanisms, it’s painstakingly difficult to understand the direction of the effects in such complex situations.

Even though there was support from mechanistic studies, cohort studies, and randomized trials looking at the effects of foods on TMAO levels, the results of this study with a random mechanism strongly suggest that the causal relationship is in the opposite direction. However, this is only one study and a small piece of the puzzle. Future studies with random mechanisms (whether they are mendelian randomization studies or randomized trials) will need to replicate these findings.

The results of this study and the history of TMAO remind me of a quote by Steve Goodman in his recent paper in The American Statistician.25

A clinical trial that shook the core of cardiology was the Cardiac Arrhythmia Suppression Trial (CAST), completed in 1991 (Echt et al. 1991). The therapies tested in the CAST trial were known to stop the arrhythmias thought responsible for sudden cardiac death, which was then killing more than one person every minute, or about 1200 per day. CAST revealed that these drugs, the most widely prescribed drugs in the United States, were almost quadrupling the sudden death rate, killing more Americans in the preceding decade than had died in most wars.

This taught the cardiology community the danger of using surrogate endpoints, and the unreliability of mechanistic knowledge more effectively than could a thousand lectures, papers or causal diagrams. Yet few physicians in other disciplines know of it and have learned that lesson. These other areas have their own stories, yet even the most dramatic, like the Duke “omics” story (Micheel et al. 2012) are little known outside their own domains.

Found this article to be informative? Consider supporting the website on Patreon!

References

1. Wang Z, Klipfell E, Bennett BJ, et al. Gut flora metabolism of phosphatidylcholine promotes cardiovascular disease. Nature. 2011;472(7341):57-63. doi:10.1038/nature09922

2. Tang WW, Wang Z, Levison BS, et al. Intestinal Microbial Metabolism of Phosphatidylcholine and Cardiovascular Risk. New England Journal of Medicine. 2013;368(17):1575-1584. doi:10.1056/NEJMoa1109400

3. Velasquez MT, Ramezani A, Manal A, Raj DS. Trimethylamine N-Oxide: The Good, the Bad and the Unknown. Toxins. 2016;8(11):326. doi:10.3390/toxins8110326

4. Yu X-H, Fu Y-C, Zhang D-W, Yin K, Tang C-K. Foam cells in atherosclerosis. Clinica Chimica Acta; International Journal of Clinical Chemistry. 2013;424:245-252. doi:10.1016/j.cca.2013.06.006

5. Heianza Y, Ma W, Manson JE, Rexrode KM, Qi L. Gut Microbiota Metabolites and Risk of Major Adverse Cardiovascular Disease Events and Death: A Systematic Review and Meta-Analysis of Prospective Studies. Journal of the American Heart Association. 2017;6(7). doi:10.1161/JAHA.116.004947

6. Meyer KA, Shea JW. Dietary Choline and Betaine and Risk of CVD: A Systematic Review and Meta-Analysis of Prospective Studies. Nutrients. 2017;9(7). doi:10.3390/nu9070711

7. Qi J, You T, Li J, et al. Circulating trimethylamine N-oxide and the risk of cardiovascular diseases: A systematic review and meta-analysis of 11 prospective cohort studies. Journal of Cellular and Molecular Medicine. 2018;22(1):185-194. doi:10.1111/jcmm.13307

8. Schiattarella GG, Sannino A, Toscano E, et al. Gut microbe-generated metabolite trimethylamine-N-oxide as cardiovascular risk biomarker: A systematic review and dose-response meta-analysis. European Heart Journal. 2017;38(39):2948-2956. doi:10.1093/eurheartj/ehx342

9. Kraus VB. Biomarkers as drug development tools: Discovery, validation, qualification and use. Nature Reviews Rheumatology. 2018;14(6):354. doi:10.1038/s41584-018-0005-9

10. Barrea L, Annunziata G, Muscogiuri G, et al. Trimethylamine-N-oxide (TMAO) as Novel Potential Biomarker of Early Predictors of Metabolic Syndrome. Nutrients. 2018;10(12). doi:10.3390/nu10121971

11. Chhibber-Goel J, Singhal V, Parakh N, Bhargava B, Sharma A. The Metabolite Trimethylamine-N-Oxide is an Emergent Biomarker of Human Health. Current Medicinal Chemistry. 2017;24(36):3942-3953. doi:10.2174/0929867323666160830104025

12. Fogelman AM. TMAO is both a Biomarker and a Renal Toxin. Circulation research. 2015;116(3):396-397. doi:10.1161/CIRCRESAHA.114.305680

13. Janeiro MH, Ram’ırez MJ, Milagro FI, Mart’ınez JA, Solas M. Implication of Trimethylamine N-Oxide (TMAO) in Disease: Potential Biomarker or New Therapeutic Target. Nutrients. 2018;10(10). doi:10.3390/nu10101398

14. Cho CE, Taesuwan S, Malysheva OV, et al. Trimethylamine-N-oxide (TMAO) response to animal source foods varies among healthy young men and is influenced by their gut microbiota composition: A randomized controlled trial. Molecular Nutrition & Food Research. 2017;61(1). doi:10.1002/mnfr.201600324

15. Zeisel SH, Mar M-H, Howe JC, Holden JM. Concentrations of choline-containing compounds and betaine in common foods. The Journal of Nutrition. 2003;133(5):1302-1307. doi:10.1093/jn/133.5.1302

16. Zhang AQ, Mitchell SC, Smith RL. Dietary precursors of trimethylamine in man: A pilot study. Food and Chemical Toxicology: An International Journal Published for the British Industrial Biological Research Association. 1999;37(5):515-520.

17. Keogh RH, White IR. A toolkit for measurement error correction, with a focus on nutritional epidemiology. Statistics in Medicine. 2014;33(12):2137-2155. doi:10.1002/sim.6095

18. Patel CJ, Burford B, Ioannidis JPA. Assessment of vibration of effects due to model specification can demonstrate the instability of observational associations. J Clin Epidemiol. 2015;68(9):1046-1058. doi:10.1016/j.jclinepi.2015.05.029

19. Aadland EK, Lavigne C, Graff IE, et al. Lean-seafood intake reduces cardiovascular lipid risk factors in healthy subjects: Results from a randomized controlled trial with a crossover design. The American Journal of Clinical Nutrition. 2015;102(3):582-592. doi:10.3945/ajcn.115.112086

20. Landfald B, Valeur J, Berstad A, Raa J. Microbial trimethylamine-N-oxide as a disease marker: Something fishy? Microbial Ecology in Health and Disease. 2017;28(1). doi:10.1080/16512235.2017.1327309

21. Jia J, Dou P, Gao M, et al. Assessment of Causal Direction Between Gut Microbiota-Dependent Metabolites and Cardiometabolic Health: Abi-Directional Mendelian Randomisation Analysis. Diabetes. June 2019:db190153. doi:10.2337/db19-0153

22. Haycock PC, Burgess S, Wade KH, Bowden J, Relton C, Davey Smith G. Best (but oft-forgotten) practices: The design, analysis, and interpretation of Mendelian randomization studies. The American Journal of Clinical Nutrition. 2016;103(4):965-978. doi:10.3945/ajcn.115.118216

23. Greenland S. Randomization, statistics, and causal inference. Epidemiology. 1990;1(6):421-429.

24. Burgess S, Thompson SG. Bias in causal estimates from Mendelian randomization studies with weak instruments. Statistics in Medicine. 2011;30(11):1312-1323. doi:10.1002/sim.4197

25. Goodman SN. Why is Getting Rid of P-Values So Hard? Musings on Science and Statistics. The American Statistician. 2019;73(sup1):26-30. doi:10.1080/00031305.2018.1558111

• Cite this blog post