What Claim Strength Actually Means in Skincare Evidence
RCTs, mechanistic studies, and expert consensus differ in what they can tell you about whether an ingredient works. Here is how to read the difference.
The short answer
Skincare claims range from claims backed by randomized controlled trials (the strongest evidence standard) to claims backed by in-vitro cell studies that may not translate to real skin. Understanding the hierarchy lets you quickly evaluate whether a claim deserves serious consideration or should be held at arm's length.
The evidence hierarchy, briefly
Randomized controlled trials (RCTs)
RCTs randomly assign participants to an active ingredient or a control (placebo or vehicle), blind the participants and assessors to which they received, and measure the outcome. The randomization controls for the fact that the kinds of people who choose to try a product may be systematically different from those who don't.
For skincare, RCTs are the standard that separates what works from what might work. Weiss 1988's double-blind, vehicle-controlled trial of tretinoin — vehicle-controlled meaning the comparison group got the same cream minus the active 1 is an RCT that establishes the evidence base for that ingredient. 2 Bissett 2005's 12-week split-face trial of 5% niacinamide 3 is the trial behind the strength most serums use — and the highest strength any niacinamide trial Drop has read tested.
Not all RCTs are equal: a 12-week RCT with 200 participants and independent outcome assessment is much stronger evidence than an 8-week RCT with 20 participants and no blinding.
Systematic reviews and meta-analyses
These aggregate and statistically combine the results of multiple RCTs. When a systematic review consistently shows a direction of effect across many studies, the confidence in that direction increases substantially. The Cochrane database is a reference standard for systematic reviews in dermatology.
Meta-analyses have their own limitations (garbage-in, garbage-out applies if the included studies are poor quality), but for active-ingredient questions with multiple trial populations, a well-conducted meta-analysis provides stronger confidence than any single RCT.
Observational studies and cohort data
These document outcomes in real-world users without randomizing or controlling for the placebo effect. Useful for identifying patterns and generating hypotheses, but not for confirming that an ingredient caused an effect. The comparison group may differ from the treatment group in ways that confound the result.
Photoaging is a place where randomized evidence is thin. Hughes 2013 set out to test sunscreen against skin aging because, in its authors' words, supporting evidence was lacking, and it randomly assigned people to daily or as-needed sunscreen for 4.5 years 4.
Expert consensus
When there is insufficient RCT evidence for a specific question, expert consensus represents the collective judgment of experienced clinicians. This is used extensively in skincare for combination safety rules ("retinol + AHA may compound irritation") that would be impractical to run as blinded RCTs in large populations. Expert consensus is genuinely informative but can be wrong — clinical practice sometimes perpetuates recommendations that later RCTs do not support.
Mechanistic evidence
Mechanistic evidence establishes a plausible pathway — in-vitro cell studies showing ingredient X activates enzyme Y, or computer modeling (in-silico — simulated, not tested on skin) showing molecule Z should penetrate the stratum corneum, the skin's outermost layer. This evidence is useful for understanding how ingredients might work but does not confirm that they produce the claimed skin effect in actual human users at cosmetic doses.
The gap between mechanistic evidence and clinical evidence is where much of the skincare marketing lives. An ingredient that activates collagen synthesis in a petri dish at 100× the concentration found in a cosmetic product is not established as a collagen-supporting ingredient in human skin. Many "clinically tested" claims in skincare are mechanistic or in-vitro studies, not RCTs.
In-vitro studies
Cell culture studies (in-vitro) test ingredient effects on isolated cells. They establish mechanistic plausibility and screen for potential. They cannot confirm skin efficacy because: the ingredient concentration used may be unrealistically high, the barrier of intact skin is absent, the cell environment is not equivalent to living human dermis, and the duration and exposure are different from cosmetic use.
Spotting weak evidence in marketing language
- "Studies show" without specifying the type of study. A 12-person in-vitro study is a "study."
- Vague clinical language (phrases like "backed by science" or "lab tested") — no regulated definition. These can refer to a participant satisfaction survey.
- "Derm tested" or "tested by skin experts" — means specialists used the product, not that it was found to be effective.
- Peer-reviewed publication — peer review means other experts reviewed the methodology, not that the conclusion is correct or that the study was adequately powered.
- "Up to" results — "up to 90% more hydration" means the best result in one participant in one measurement. The average result may be far lower.
How Drop uses evidence levels
Drop's ingredient database and citation system grades each claim. The ladder runs: trial, review of trials, expert agreement, real-world study, lab work, or debated. This surfaces the quality of evidence behind each claim, so you can see not just what an ingredient is said to do, but how confidently the claim should be held.
For concentration claims with RCT evidence 3, confidence is high; for the AHA pH limits the evidence is a safety panel's recommendation rather than a trial 5, and we label it that way. For mechanistic claims about novel ingredients or in-vitro extrapolations, confidence is held lower and we label the uncertainty.
Bottom line
RCTs and systematic reviews establish that an ingredient works. Expert consensus establishes that experienced clinicians think it works or should be used safely. Mechanistic and in-vitro evidence establishes that there is a plausible reason it might work. Most skincare marketing conflates these categories. Drop's approach is to label each claim with its evidence source and let you decide how much weight to place on it 53.
Ingredients here
Sources · 5
- 1.RCT-level evidence"Daily topical application of 0.05% tretinoin in a cream base was compared with its vehicle" and "It was concluded that topical tretinoin is capable of at least partly reversing the structural damages of excessive sunlight exposure". One strength, no comparison of strengths. Based on the abstract only.Kligman AM, Grove GL, Hirose R, Leyden JJ (1986). Topical tretinoin for photoaged skin. Journal of the American Academy of Dermatology. View source ↗"In a 16-week randomized, double-blind, vehicle-controlled study of topical tretinoin in the treatment of photoaging" and "Fourteen of the 15 patients who received tretinoin to the face had improvement in photoaging, whereas none of the vehicle-treated patients' faces improved" and "Side effects were limited to irritation of tretinoin-exposed skin." The abstract names no strength; Mukherjee 2006 lists this trial at 0.1%, not 0.05%. Based on the abstract only.Weiss JS, Ellis CN, Headington JT, Tincoff T, Hamilton TA, Voorhees JJ (1988). Topical tretinoin improves photoaged skin: a double-blind vehicle-controlled study. JAMA. View source ↗"A total of 204 subjects were treated with tretinoin or placebo (vehicle emollient cream) applied to the entire face once a day for up to 2 years." "Histologic evaluation showed no increase in keratinocytic or melanocytic atypia" and "Long-term treatment with tretinoin emollient cream 0.05% is safe and effective in subjects with moderate to severe facial photodamage." One strength, once daily; no ramp and no comparison of strengths. Based on the abstract only.Kang S, Bergfeld W, Gottlieb AB, et al. (2005). Long-term efficacy and safety of tretinoin emollient cream 0.05% in the treatment of photodamaged facial skin: a two-year, randomized, placebo-controlled trial. American Journal of Clinical Dermatology. View source ↗Its Table 2 lists "Weiss et al (1988) Randomized, Double-blind 0.1% tretinoin cream vs vehicle 30 4 months". It reports the one comparison of strengths Drop knows of: Griffiths' trial "compared clinical efficacy and tolerability of 0.025% and 0.1% tretinoin cream", found "no clinically or statistically significant differences between the two concentrations of tretinoin", and "the incidences of adverse effects were significantly greater in the 0.1% tretinoin group as compared with the 0.025% tretinoin group." It adds that "low strength tretinoin might be a good option for those patients who can not tolerate standard therapy (0.05%)." Drop has not read Griffiths itself, only this review's summary of it.Mukherjee S, Date A, Patravale V, Korting HC, Roeder A, Weindl G (2006). Retinoids in the treatment of skin aging: an overview of clinical efficacy and safety. Clinical Interventions in Aging. View source ↗
- 2.RCT-level evidenceDesign: "In a 16-week randomized, double-blind, vehicle-controlled study of topical tretinoin in the treatment of photoaging, all patients applied topical tretinoin to one forearm and vehicle cream to the other." and "Half of the patients received tretinoin to the face, and half received vehicle cream." Results: "All 30 patients who completed the study showed statistically significant improvement in photoaging on the tretinoin-treated forearms, but not on the vehicle-treated forearms." and "Fourteen of the 15 patients who received tretinoin to the face had improvement in photoaging, whereas none of the vehicle-treated patients' faces improved". Safety, the whole of it: "Side effects were limited to irritation of tretinoin-exposed skin." The abstract names no tretinoin strength. Based on the abstract only.Weiss JS; Ellis CN; Headington JT; Tincoff T; Hamilton TA; Voorhees JJ (1988). Topical tretinoin improves photoaged skin. A double-blind vehicle-controlled study. JAMA. View source ↗
- 3.RCT-level evidenceSplit-face trial. The method: "applied 5% niacinamide to half of the face and its vehicle control to the other half twice daily for 12 weeks" The results: "reductions in fine lines and wrinkles, hyperpigmented spots, red blotchiness, and skin sallowness (yellowing)" On tolerance, from earlier studies: "topical niacinamide (vitamin B3) has been observed to be well tolerated by skin" It tests no strength other than 5%. Based on the abstract only.Bissett DL, Oblong JE, Berge CA (2005). Niacinamide: A B Vitamin that Improves Aging Facial Skin Appearance. Dermatologic Surgery. View source ↗Clinical trials plus lab work. The strengths: "18 subjects with hyperpigmentation who used 5% niacinamide moisturizer and vehicle moisturizer in a paired design, and 120 subjects with facial tanning who were assigned to two of three treatments: vehicle, sunscreen and 2% niacinamide + sunscreen" The result: "niacinamide significantly decreased hyperpigmentation and increased skin lightness compared with vehicle alone after 4 weeks of use" Based on the abstract only.Hakozaki T, Minwalla L, Zhuang J, et al. (2002). The effect of niacinamide on reducing cutaneous pigmentation and suppression of melanosome transfer. British Journal of Dermatology. View source ↗Randomized split-face trial: "Twenty-seven melasma patients were randomized to receive for eight weeks 4% niacinamide cream on one side of the face, and 4% HQ cream on the other." On side effects: "Side effects were present in 18% with niacinamide versus 29% with HQ." Based on the abstract only.Navarrete-Solís J, Castanedo-Cázares JP, Torres-Álvarez B, et al. (2011). A Double-Blind, Randomized Clinical Trial of Niacinamide 4% versus Hydroquinone 4% in the Treatment of Melasma. Dermatology Research and Practice. View source ↗
- 4.RCT-level evidenceDesign: "Randomized, controlled, community-based intervention." with "903 adults younger than 55 years out of 1621 adults randomly selected from a community register." What was measured: "Change in microtopography between 1992 and 1996 in the sunscreen and β-carotene groups compared with controls, graded by assessors blinded to treatment allocation." The result: "The daily sunscreen group showed no detectable increase in skin aging after 4.5 years." and "Skin aging from baseline to the end of the trial was 24% less in the daily sunscreen group than in the discretionary sunscreen group (relative odds, 0.76 [95% CI, 0.59 to 0.98])." Its own limits: "Some outcome data were missing, and power to detect moderate treatment effects was modest." Why it was run: "Sunscreen use and dietary antioxidants are advocated as preventives of skin aging, but supporting evidence is lacking." Based on the abstract only.Hughes MC; Williams GM; Baker P; Green AC (2013). Sunscreen and prevention of skin aging: a randomized trial. Annals of internal medicine. View source ↗
- 5.Expert consensusClinical study. It compared strengths, not pH: "The purpose was to examine whether treatment with 5% and 12% lactic acid produces different cosmetic results and produces changes in the epidermis and dermis." Result: "Although 5% lactic acid modulates surface and epidermal changes, 12% lactic acid influences both the epidermis and the dermis." Based on the abstract only.Smith WP (1996). Epidermal and dermal effects of topical lactic acid. Journal of the American Academy of Dermatology. View source ↗Review. The safety limits: "To reduce the risk of skin irritation, the CIR Panel recommended limitations on the concentration of αHAs (<10%) and the pH (at or above 3.5) of cosmetic products containing αHAs." On mechanism: "When Ca is decreased, cellular adhesions are disrupted and exfoliation takes place." On PHAs: "A new generation of αHAs, called PHAs and polyhydroxy bionic acids (PHBAs), provide effects similar to αHAs but with less irritation responses. PHAs, such as lactobionic acid" And: "these molecules function as humectants and moisturizers, as well as providing antioxidant chelation effects." "The most popular PHA marketed today is gluconolactone" "The glycolic acid-treated skin demonstrated a significant increase in sunburn cells, whereas the gluconolactone-treated site did not." It gives no pKa values and no pH-versus-exfoliation curve.Kornhauser A, Coelho SG, Hearing VJ (2010). Applications of hydroxy acids: classification, mechanisms, and photoactivity. Clinical and Cosmetic Investigative Dermatology. View source ↗Consumer guidance from the FDA: "The extent of exfoliation depends on the type and concentration of the AHA, its pH, and other ingredients in the product." On the industry safety panel's limits for glycolic and lactic acid: "The AHA concentration is 10 percent or less." and "The final product has a pH of 3.5 or greater." On sun: "If you are using AHAs, it is advisable to use sun protection." Its list of AHAs: "The most common AHAs in cosmetic products are glycolic acid and lactic acid. Among others are citric acid, hydroxycaprylic acid, and hydroxycapric acid."U.S. Food and Drug Administration (2022). Alpha Hydroxy Acids. FDA cosmetics guidance (fda.gov). View source ↗Comparative study: "Both l(+) and the d(-) forms are better moisturizers when fully or partially neutralized." Based on the abstract only.Smith WP (1996). Comparative effectiveness of alpha-hydroxy acids on skin properties. International Journal of Cosmetic Science. View source ↗