Skip to content

Review

Frontiers in Drug Discovery ·

Volume 6 - 2026 | https://doi.org/10.3389/fddsv.2026.1854899

A survey of LLMs in drug discovery and precision medicine

  • Hasi Hays1*corresponding author
  • William J. Richardson1*corresponding author
  1. Department of Chemical Engineering, University of Arkansas, Fayetteville, AR, United States
Article metrics0 viewsView details

Abstract

The convergence of artificial intelligence and biomedical research has catalyzed emerging impact in drug discovery and precision medicine. Large language models (LLMs), originally developed for natural language processing, have emerged as powerful tools capable of processing complex biomedical data, from molecular structures to clinical records. This comprehensive review examines the state-of-the-art applications of LLMs across the drug development pipeline, spanning target identification, molecular generation, property prediction, and drug repurposing in drug discovery, as well as clinical decision support, patient stratification, treatment personalization, and genomic interpretation in precision medicine. We analyze the technical methodologies underlying these applications, including multi-modal architectures, knowledge-guided approaches, and retrieval augmented generation systems. Through examination of recent advances, we highlight key achievements such as end-to-end drug discovery pipelines, multi-agent systems for clinical simulation, and knowledge-enhanced models achieving state-of-the-art performance. We critically assess current challenges, including data privacy, model interpretability, hallucination risks, and ethical considerations. Finally, we discuss future directions, emphasizing the potential for federated learning, explainable artificial intelligence, and integrated multiscale approaches to advance the field toward more reliable, transparent, and clinically applicable systems.

Keywords

1 Introduction

The pharmaceutical industry faces unprecedented challenges in developing safe, effective, and personalized therapeutics. Traditional drug discovery remains a lengthy and expensive endeavor, with average development timelines exceeding 10–15 years and costs surpassing $2.6 billion per approved drug (DiMasi et al., 2016; Wouters et al., 2020). The attrition rate in clinical trials remains alarmingly high, with approximately 90% of drug candidates failing to receive regulatory approval, often due to unforeseen toxicity or lack of efficacy that could not be predicted during preclinical development (Vamathevan et al., 2019; Paul et al., 2021). Simultaneously, the promise of precision medicine, which aims to tailor treatments to individual patient characteristics including genetic makeup, lifestyle, and environmental factors, remains partially unfulfilled due to the inherent complexity of integrating multiscale biomedical data across molecular, cellular, tissue, and organismal levels (Esteva et al., 2019; Rajkomar et al., 2018). The convergence of artificial intelligence and biomedical research offers emerging impact to address these longstanding challenges, with large language models emerging as particularly powerful and versatile tools capable of processing and synthesizing information across diverse data modalities (Figure 1) (Wang et al., 2023; Thirunavukarasu et al., 2023).

Overview of large language models in drug discovery and precision medicine. LLMs integrate multi-modal biomedical data (text, molecular structures, proteins, genomics) through knowledge-guided architectures. In drug discovery, these models enable target identification, *de novo* molecule generation, ADMET property prediction, and drug repurposing. In precision medicine, LLMs support patient stratification, genomic interpretation, personalized treatment selection, and clinical decision support by integrating genomics, single-cell data, and clinical records. Key challenges and future directions include addressing data privacy, model explainability, hallucination risks, and regulatory considerations, while advancing multi-agent systems, explainable AI, federated learning approaches, and development of novel and efficient models. Created in BioRender. Hays (2026) [https://BioRender.com/879058c](https://BioRender.com/879058c) (Academic Publication License, agreement number LZ29VNAPVN).
Figure 1. Overview of large language models in drug discovery and precision medicine. LLMs integrate multi-modal biomedical data (text, molecular structures, proteins, genomics) through knowledge-guided architectures. In drug discovery, these models enable target identification, de novo molecule generation, ADMET property prediction, and drug repurposing. In precision medicine, LLMs support patient stratification, genomic interpretation, personalized treatment selection, and clinical decision support by integrating genomics, single-cell data, and clinical records. Key challenges and future directions include addressing data privacy, model explainability, hallucination risks, and regulatory considerations, while advancing multi-agent systems, explainable AI, federated learning approaches, and development of novel and efficient models. Created in BioRender. Hays (2026) https://BioRender.com/879058c (Academic Publication License, agreement number LZ29VNAPVN).

Large language models represent a paradigm shift in artificial intelligence, demonstrating remarkable capabilities in understanding and generating human language through deep learning on massive text corpora (Vaswani et al., 2017; Devlin et al., 2019; Brown et al., 2020). Models such as GPT (Generative Pre-trained Transformer), BERT (Bidirectional Encoder Representations from Transformers), and their derivatives have achieved unprecedented performance across diverse linguistic tasks, from text classification and question answering to creative writing and code generation (Radford et al., 2019; OpenAI, 2023). The fundamental insight driving their success is that self-supervised learning on vast amounts of text enables the extraction of rich semantic representations that capture not only syntactic patterns but also complex reasoning capabilities and world knowledge (Brown et al., 2020; Wei et al., 2022).

This insight has proven surprisingly transferable to biomedical domains, where diverse data types including molecular SMILES strings, protein amino acid sequences, genomic nucleotide sequences, and clinical narratives can be treated as specialized languages with their own syntax, grammar, and semantic relationships (Lee et al., 2020; Luo et al., 2022; Singhal et al., 2023). The ability of these models to learn meaningful representations from sequential data, regardless of whether that data represents English text or chemical structures, has opened new avenues for computational approaches to drug discovery and clinical decision making.

Recent years have witnessed explosive growth in applying LLMs to drug discovery and precision medicine, fundamentally reshaping how researchers approach complex biomedical problems (Schneider et al., 2020; Mak and Pichika, 2019). These models can process and integrate heterogeneous data types spanning multiple scales of biological organization, from atomic level molecular structures and protein sequences to patient level electronic health records and population level epidemiological data (Vamathevan et al., 2019; Shickel et al., 2018). In drug discovery, LLMs enable tasks that previously required extensive domain expertise or costly experimental validation, including target identification from disease biology, de novo molecular generation with desired properties, absorption, distribution, metabolism, excretion, and toxicity (ADMET) prediction, and systematic drug repurposing through knowledge synthesis (Stokes et al., 2020; Zhavoronkov et al., 2019; Bilodeau et al., 2022). In precision medicine, these models are transforming clinical decision support by analyzing unstructured clinical notes, enabling sophisticated patient stratification based on multi-modal data, personalizing treatment recommendations, and interpreting complex genomic variants (Singhal et al., 2023; Nori et al., 2023). The ability of LLMs to perform zero-shot and few-shot learning, making accurate predictions on novel tasks with minimal or no task-specific training examples, is particularly valuable in biomedical contexts where labeled data for specific applications may be scarce, expensive to obtain, or simply nonexistent for emerging diseases or novel therapeutic targets (Brown et al., 2020; Kojima et al., 2022).

The evolution of biomedical LLMs has followed a distinct trajectory from their general-purpose counterparts, with successive waves of domain-adapted text models (BioBERT, PubMedBERT, ClinicalBERT), generative biomedical models (BioGPT, Med-PaLM 2, MEDITRON-70B), and modality-specific foundation models for molecules, proteins, genomes, and single cells (ChemBERTa, ESM-2, DNABERT-2, scGPT) (Lee et al., 2020; Luo et al., 2022; Singhal et al., 2023; Gu et al., 2021; Alsentzer et al., 2019; Chithrananda et al., 2020; Lin et al., 2023; Zhou et al., 2023; Cui et al., 2024). A full technical treatment of these architectures, their pretraining strategies, and their multi-modal extensions is given in Section 2; here we highlight only that this diversification has produced an ecosystem of specialised models rather than a single general-purpose biomedical LLM, and that multi-modal architectures linking molecules, sequences, and natural language remain an active and unsettled research frontier (Cao et al., 2023; Liu S. et al., 2023; Taylor et al., 2022).

The emerging impact of LLMs in biomedicine extends beyond individual predictive tasks to encompass entire workflows and research paradigms. Recent work has demonstrated the feasibility of autonomous AI systems capable of designing, executing, and analyzing chemical experiments with minimal human intervention (Boiko et al., 2023). Multi-agent architectures employing specialized LLM agents for different aspects of drug discovery, from literature review and hypothesis generation to molecular design and virtual screening, are beginning to mirror the collaborative nature of real world research teams (Bran et al., 2024; Park et al., 2023). These developments suggest a future in which AI systems serve not merely as tools for specific tasks but as collaborative partners in the scientific discovery process, accelerating the pace of biomedical research while potentially democratizing access to sophisticated computational capabilities (Wang et al., 2023). At the same time, the evidence base for these capabilities remains uneven: most reported gains come from benchmark accuracy on retrospective datasets rather than prospective clinical or wet-lab validation, and statements such as “expert-level performance” or “transformative potential” should therefore be read as conditional on the specific dataset, task, and evaluation protocol. As discussed in Section 7, claims of expert-level performance on USMLE-style questions (Singhal et al., 2023; Nori et al., 2023) are not equivalent to expert-level performance in real clinical workflows, and current AI-designed drug candidates have begun Phase I/II trials but have not yet produced an approved therapeutic (Xu et al., 2025). However, realizing this potential requires careful attention to the limitations and risks associated with LLM deployment in high stakes biomedical applications, including concerns about hallucination, interpretability, data privacy, and algorithmic bias that could perpetuate or exacerbate health disparities (Thirunavukarasu et al., 2023; Obermeyer et al., 2019; Gerke et al., 2020).

This review provides a comprehensive examination of LLM applications in drug discovery and precision medicine, synthesizing findings from the rapidly evolving literature published between 2018 and 2025. We analyze the technical foundations underlying these approaches, including transformer architectures, pretraining strategies, multi-modal integration methods, and knowledge enhancement techniques. We survey key applications across the drug development pipeline, from early stage target identification through clinical trial design, as well as precision medicine applications spanning clinical decision support, patient stratification, and genomic interpretation. We critically assess current limitations, including challenges related to data quality and availability, model interpretability, hallucination risks, data privacy concerns, computational resource requirements, and ethical considerations. Finally, we discuss future directions that hold promise for advancing the field toward more reliable, transparent, and clinically applicable systems. Our goal is to provide researchers, clinicians, and industry practitioners with a thorough understanding of how LLMs are reshaping biomedical research and clinical practice, while highlighting both the tremendous opportunities and the substantial challenges that must be addressed to realize their full potential for improving human health. The remainder of this paper is organized as follows. Section 2 provides background on the evolution of LLMs and their adaptation to biomedical contexts, covering foundational architectures, pretraining strategies, and key design considerations for biological applications. Section 3 examines applications in drug discovery, spanning target identification, molecular generation, property prediction, drug repurposing, and integrated discovery pipelines. Section 4 discusses precision medicine applications, including clinical decision support, patient stratification, treatment personalization, and genomic interpretation. Section 5 presents technical methodologies and architectural innovations that enable these applications. Section 6 surveys current applications and case studies demonstrating real world impact. Section 7 addresses challenges, limitations, and risks associated with LLM deployment in biomedicine. Section 8 explores future directions and emerging opportunities. Finally, Section 9 concludes with a synthesis of key insights and recommendations for advancing the field.

2 Background and theoretical foundations

2.1 Evolution of large language models

Large language models represent the culmination of decades of progress in natural language processing and deep learning, building upon foundational advances in neural network architectures, optimization algorithms, and distributed computing infrastructure (Vaswani et al., 2017). The transformer architecture, introduced by Vaswani and colleagues in 2017, provided the critical innovation enabling modern LLMs through its self-attention mechanism, which allows models to capture long-range dependencies in sequential data without the vanishing gradient problems that plagued earlier recurrent architectures (Vaswani et al., 2017). The self-attention mechanism computes a weighted sum of all positions in a sequence, where the weights are determined by the relevance of each position to the current position being processed, enabling the model to directly attend to any part of the input regardless of distance (Hays, 2026a). This architectural innovation, combined with positional encodings to preserve sequence order information, has proven remarkably effective for modeling both natural language and biological sequences, establishing the foundation for essentially all modern large language models (Devlin et al., 2019; Brown et al., 2020).

The evolution of LLMs can be characterized by two complementary paradigms that have shaped the field: bidirectional encoder models exemplified by BERT and autoregressive decoder models exemplified by GPT (Devlin et al., 2019; Radford et al., 2019). BERT, introduced by Devlin and colleagues in 2018, employs masked language modeling as its pretraining objective, where the model learns to predict randomly masked tokens in a sequence by attending to context on both sides (Devlin et al., 2019). This bidirectional approach produces rich contextual representations that have proven particularly effective for understanding and classification tasks, where the full context is available at inference time. In contrast, the GPT family of models employs autoregressive language modeling, predicting the next token given all previous tokens, which naturally supports open-ended generation tasks but processes context in only one direction (Brown et al., 2020; Radford et al., 2019).

GPT-3, with its 175 billion parameters, demonstrated the remarkable emergent capabilities that arise from scaling model size and training data, including the ability to perform novel tasks through in-context learning without parameter updates (Brown et al., 2020). GPT-4 further extended these capabilities with improved reasoning, reduced hallucination, and multi-modal understanding incorporating both text and images (OpenAI, 2023). The PaLM family from Google demonstrated that further scaling to 540 billion parameters yields additional improvements in reasoning and multilingual capabilities (Chowdhery et al., 2023), while open-source models such as LLaMA and LLaMA-2 have democratized access to capable foundation models that can be fine-tuned for specific applications (Touvron et al., 2023a; Touvron et al., 2023b).

A particularly important development in recent years has been the emergence of instruction tuning and reinforcement learning from human feedback (RLHF) as techniques for aligning LLM behavior with human intentions and values. Rather than simply predicting the next token in training text, instruction-tuned models are trained to follow natural language instructions describing desired tasks, substantially improving their ability to generalize to novel tasks at inference time (Wei et al., 2022). RLHF further refines model outputs by training a reward model on human preferences and then optimizing the language model to produce outputs that maximize predicted reward. These alignment techniques have proven essential for creating models that are helpful, harmless, and honest in their interactions with users, considerations that are particularly important for high-stakes biomedical applications where misleading or harmful outputs could have serious consequences. The combination of massive pretraining, instruction tuning, and human feedback alignment has produced models with unprecedented capabilities for understanding complex queries, following multi-step instructions, and engaging in nuanced reasoning across diverse domains including medicine and biology.

Figure 2 organises the models surveyed here as an evolutionary tree, tracing how domain-adapted biomedical, molecular, protein, genomic, single-cell, and clinical models descend from a small set of general-purpose transformer foundation models along three architectural branches (encoder-only, encoder-decoder, and decoder-only). This lineage view emphasises which base model each framework is derived from, and complements the quantitative timeline in Figure 3, which represents model scale and the category.

Evolutionary tree illustrating the biomedical and drug-discovery large language models (2018–2025). Phylogeny-style diagram tracing the lineage of the biomedical, clinical, molecular, protein, genomic, single-cell, drug-discovery, and multi-functional LLMs catalogued in this review. Models are organised along three architectural branches (encoder-only on the left, encoder-decoder in the centre, and decoder-only on the right) and positioned vertically by release year, all descending from a common set of general-purpose transformer foundation models (e.g., BERT, GPT, T5, PaLM, LLaMA) shown as anchor roots at the base of the tree. Node colour denotes the architecture branch. In most cases, the preprint publication date is used. Institutional logos most commonly represent the institution(s) of the corresponding author(s); in some cases, only the primary institution(s) are included. The tree emphasises derivation and inheritance relationships (which base model each framework is built upon).
Figure 2. Evolutionary tree illustrating the biomedical and drug-discovery large language models (2018–2025). Phylogeny-style diagram tracing the lineage of the biomedical, clinical, molecular, protein, genomic, single-cell, drug-discovery, and multi-functional LLMs catalogued in this review. Models are organised along three architectural branches (encoder-only on the left, encoder-decoder in the centre, and decoder-only on the right) and positioned vertically by release year, all descending from a common set of general-purpose transformer foundation models (e.g., BERT, GPT, T5, PaLM, LLaMA) shown as anchor roots at the base of the tree. Node colour denotes the architecture branch. In most cases, the preprint publication date is used. Institutional logos most commonly represent the institution(s) of the corresponding author(s); in some cases, only the primary institution(s) are included. The tree emphasises derivation and inheritance relationships (which base model each framework is built upon).
Evolution of large language models for drug discovery and biomedicine. Timeline showing the development of 93 representative language models and LLM-based frameworks from 2018 to 2025, categorized by application domain (General, Biomedical, Clinical, Protein, Molecular, Genomic, Single-cell, Drug Discovery, and Multi-functional). Both circle size and circle colour encode the reported model scale (logarithmic, from ∼45 M to ∼1.8 T parameters; the *viridis* colour scale is shown at right), while the horizontal shaded bands and the y-axis denote the application domain; open circles with grey outlines denote LLM-based frameworks for which no parameter count is reported. The figure was substantially expanded in this revision by integrating additional models tabulated in the recent overview by Song et al. (2025) (Tables 1–4), which catalogues LLMs and LLM-driven frameworks used in disease-target prediction, lead-compound design and optimisation, drug-target interaction prediction, molecular property prediction, drug-drug interaction prediction, and multi-functional drug-discovery applications. Data sources: publication dates verified from original papers (Devlin et al., 2019; Lee et al., 2020; Singhal et al., 2023; Lin et al., 2023; Cui et al., 2024) and from Song et al. (2025).
Figure 3. Evolution of large language models for drug discovery and biomedicine. Timeline showing the development of 93 representative language models and LLM-based frameworks from 2018 to 2025, categorized by application domain (General, Biomedical, Clinical, Protein, Molecular, Genomic, Single-cell, Drug Discovery, and Multi-functional). Both circle size and circle colour encode the reported model scale (logarithmic, from ∼45 M to ∼1.8 T parameters; the viridis colour scale is shown at right), while the horizontal shaded bands and the y-axis denote the application domain; open circles with grey outlines denote LLM-based frameworks for which no parameter count is reported. The figure was substantially expanded in this revision by integrating additional models tabulated in the recent overview by Song et al. (2025) (Tables 1–4), which catalogues LLMs and LLM-driven frameworks used in disease-target prediction, lead-compound design and optimisation, drug-target interaction prediction, molecular property prediction, drug-drug interaction prediction, and multi-functional drug-discovery applications. Data sources: publication dates verified from original papers (Devlin et al., 2019; Lee et al., 2020; Singhal et al., 2023; Lin et al., 2023; Cui et al., 2024) and from Song et al. (2025).

2.2 Biomedical language models

Biomedical language models represent specialized LLMs trained on domain-specific data to capture the unique vocabulary, syntactic patterns, and semantic relationships that characterize biomedical domains (Figure 3) (Lee et al., 2020; Gu et al., 2021). The biomedical literature contains highly specialized terminology, acronyms, and naming conventions that differ substantially from general English text, and biomedical reasoning often requires understanding complex causal and mechanistic relationships between biological entities (Peng et al., 2019). Early work demonstrated that general-purpose language models pretrained on web text and books underperformed specialized models on biomedical natural language processing tasks, motivating the development of domain-adapted alternatives (Lee et al., 2020; Alsentzer et al., 2019). BioBERT, introduced by Lee and colleagues in 2020, pioneered the approach of continued pretraining of BERT on biomedical literature, using PubMed abstracts and PubMed Central full-text articles to adapt the model’s representations to biomedical language (Lee et al., 2020). This relatively simple approach of domain-adaptive pretraining yielded substantial improvements on biomedical benchmarks including named entity recognition, relation extraction, and question answering. PubMedBERT, developed by Gu and colleagues, demonstrated that pretraining from scratch on an in-domain corpus, rather than continued pretraining from a general-domain checkpoint, could yield additional improvements by avoiding the domain shift between general and biomedical vocabularies (Gu et al., 2021). ClinicalBERT adapted the approach specifically for clinical text, pretraining on clinical notes from the MIMIC-III database to capture the distinctive characteristics of clinical documentation including abbreviations, templated language, and references to specific clinical workflows (Alsentzer et al., 2019). These foundational models established biomedical NLP as a distinct subfield with its own benchmarks, datasets, and evaluation protocols.

More recent developments have extended biomedical language models to generative tasks and larger scales. BioGPT, developed by Luo and colleagues, applied the GPT architecture and autoregressive pretraining to biomedical literature, demonstrating state-of-the-art performance on biomedical text generation and question answering tasks (Luo et al., 2022). Med-PaLM and Med-PaLM 2 from Google demonstrated that appropriately prompted and aligned large language models can achieve benchmark-level performance on medical licensing examinations and clinical reasoning benchmarks (Singhal et al., 2023). MEDITRON-70B represents an open-source effort to create a large medical language model by continued pretraining of LLaMA-2 on carefully curated medical literature and guidelines (Chen et al., 2023). These generative models offer capabilities beyond the classification and extraction tasks that characterized earlier work, enabling interactive question answering, clinical decision support, and synthesis of complex medical information.

Biomedical language models are typically pretrained on diverse data sources that provide complementary perspectives on biomedical knowledge:

  • Scientific literature: PubMed contains over 35 million citations to biomedical literature, with abstracts providing concise summaries of research findings, while PubMed Central provides full-text access to millions of articles enabling richer contextual learning
  • Clinical documentation: Electronic health records capture the longitudinal medical history of patients, including clinical notes, laboratory results, imaging reports, and medication records that reflect real-world clinical practice
  • Biomedical databases: Structured resources such as DrugBank, ChEMBL, UniProt, and the Gene Ontology provide curated information about drugs, proteins, genes, and their relationships (Wishart et al., 2018; Mendez et al., 2019)
  • Clinical guidelines: Evidence-based practice guidelines from organizations such as the National Comprehensive Cancer Network and the American College of Cardiology codify expert consensus on clinical decision making
  • Regulatory documents: FDA drug labels, clinical trial protocols, and adverse event reports provide authoritative information on drug safety and efficacy

The choice of pretraining data significantly impacts model capabilities and biases. Models trained primarily on research literature may excel at answering scientific questions but struggle with practical clinical scenarios, while models trained on clinical notes may capture the nuances of clinical practice but lack access to cutting-edge research findings. Increasingly, developers are exploring strategies that combine multiple data sources to create models with broad biomedical competence.

2.3 Molecular and protein language models

A particularly exciting development in biomedical AI has been the recognition that molecular structures and biological sequences can be treated as specialized languages, enabling the application of transformer architectures and language modeling techniques to chemical and biological data (Ross et al., 2022; Rives et al., 2021). This insight has given rise to a family of molecular and protein language models that learn meaningful representations from sequence data without requiring labeled examples, analogous to how text language models learn from unlabeled corpora. For small molecules, the simplified molecular input line entry system (SMILES) notation provides a text-based representation of molecular structures that can be processed by language models (Segler et al., 2018). ChemBERTa and its successor ChemBERTa-2 apply BERT-style masked language modeling to SMILES strings, learning representations that capture chemical substructure patterns and molecular properties (Chithrananda et al., 2020; Ahmad et al., 2022). MolGPT applies autoregressive language modeling to molecular generation, learning to produce valid SMILES strings with desired properties (Bagal et al., 2022). Chemformer uses a sequence-to-sequence transformer architecture for tasks including reaction prediction and retrosynthesis (Irwin et al., 2022). More recent work has explored larger-scale pretraining, demonstrating that neural scaling laws observed in natural language also apply to chemical language models, with larger models exhibiting improved performance on property prediction and generation tasks (Ross et al., 2022; Frey et al., 2023).

Protein language models have achieved remarkable success by treating amino acid sequences as natural language and applying similar pretraining strategies. ESM-1b and ESM-2, developed by Meta AI, demonstrated that transformer models pretrained on millions of protein sequences through masked language modeling learn representations that capture evolutionary relationships, protein structure, and functional properties without any explicit structural supervision (Lin et al., 2023; Rives et al., 2021). The attention patterns learned by these models correlate with protein contact maps, suggesting that the models implicitly learn three-dimensional structural information from sequence data alone (Rives et al., 2021). ESMFold leverages these learned representations to predict protein structures with accuracy approaching AlphaFold2 for many proteins, while requiring orders of magnitude less computation at inference time (Lin et al., 2023). ProtTrans applied multiple transformer architectures to protein sequences, demonstrating that different architectures capture complementary aspects of protein biology (Elnaggar et al., 2021). ProtGPT2 uses autoregressive language modeling to generate novel protein sequences that fold into stable structures and exhibit desired functional properties (Ferruz et al., 2022). ProGen demonstrated that protein language models can generate functional enzymes across diverse protein families, with some generated sequences experimentally validated to have catalytic activity (Madani et al., 2023). Genomic language models extend similar approaches to DNA and RNA sequences, capturing regulatory patterns and sequence-function relationships. DNABERT applies BERT-style pretraining to DNA sequences, learning representations that improve performance on tasks including promoter prediction, splice site identification, and transcription factor binding site recognition (Ji et al., 2021). DNABERT-2 improves upon this approach with more efficient tokenization and larger-scale pretraining (Zhou et al., 2023). The Nucleotide Transformer represents a particularly large-scale effort, pretraining on genomes from thousands of species to learn representations that capture cross-species evolutionary patterns (Dalla-Torre et al., 2023). HyenaDNA introduces efficient long-range sequence modeling through the Hyena architecture, enabling modeling of sequences up to 1 million nucleotides at single-nucleotide resolution (Nguyen et al., 2024). These genomic language models are enabling new approaches to variant effect prediction, gene expression modeling, and regulatory sequence design.

2.4 Multi-modal integration

A critical advancement in biomedical LLMs is the integration of multiple data modalities within unified architectures (Cao et al., 2023; Liu S. et al., 2023). Drug discovery and precision medicine inherently involve diverse data types including molecular structures, protein sequences, genomic variants, clinical phenotypes, medical images, and natural language descriptions that must be jointly analyzed for comprehensive understanding. Multi-modal LLMs address this challenge by learning aligned representations across modalities, enabling reasoning that spans different data types. Multi-modal architectures typically employ separate encoders for different data types, with alignment mechanisms that map representations into a shared semantic space where meaningful cross-modal operations become possible (Liu S. et al., 2023). For example, a model might use a graph neural network to encode molecular structures, a transformer to encode protein sequences, and another transformer to encode natural language, with contrastive learning or cross-attention mechanisms to align these representations. The aligned representation space enables capabilities such as text-based molecular retrieval (finding molecules matching a natural language description), molecule captioning (generating natural language descriptions of molecular properties), and cross-modal prediction (predicting molecular properties from text descriptions). InstructMol represents a pioneering approach to multi-modal molecular understanding, aligning molecular structures with natural language through a two-stage instruction-tuning approach (Cao et al., 2023). In the first stage, separate encoders for molecules and text are pretrained on their respective data types. In the second stage, the combined system is fine-tuned on instruction-following tasks that require reasoning across both modalities, such as answering questions about molecules or generating molecules matching text descriptions. This approach enables the model to leverage both the structural information encoded in molecular representations and the semantic knowledge captured in language model representations, bridging the gap between chemical and natural language understanding.

Text-molecule translation represents another approach to multi-modal integration, treating the problem of connecting molecules and language as a machine translation task (Edwards et al., 2022a). Models trained for this task can translate between SMILES representations and natural language descriptions of molecular properties, mechanism of action, or therapeutic indications. MolT5 and related approaches use sequence-to-sequence transformer architectures to perform bidirectional translation between molecules and text, enabling both molecule captioning and text-conditioned molecule generation (Edwards et al., 2022a). More recent work has explored multi-modal molecule-text models that learn to jointly embed molecules and text in a shared space, enabling text-based retrieval and editing of molecules (Liu S. et al., 2023). ChatMol and similar systems provide interactive interfaces for molecular discovery, allowing users to explore chemical space through natural language conversation (Zeng et al., 2024). Beyond molecules, multi-modal integration in biomedicine increasingly encompasses images, structured data, and complex biological entities. Galactica represents an ambitious effort to create a language model capable of scientific reasoning across modalities including text, mathematical equations, chemical formulas, and protein sequences (Taylor et al., 2022). BiomedGPT aims for a unified generalist model capable of handling vision, language, and multi-modal biomedical tasks (Zhang et al., 2024). These efforts toward general-purpose biomedical AI systems suggest a future where a single model can seamlessly integrate information from literature, molecular databases, clinical records, and medical images to support complex biomedical reasoning.

2.5 Knowledge-guided approaches

Pure data-driven approaches, while powerful, may struggle with the inherent complexity and sparsity of biomedical data, particularly for rare diseases, novel therapeutic targets, or patient populations underrepresented in training data (Mohamed et al., 2021; Bonner et al., 2022). Knowledge-guided LLMs address these limitations by explicitly incorporating structured domain knowledge, including biomedical ontologies, knowledge graphs, and curated databases, to constrain and enhance model reasoning. Biomedical knowledge graphs provide structured representations of entities such as drugs, diseases, genes, proteins, and pathways along with their relationships (Mohamed et al., 2021; Bonner et al., 2022). Resources such as DrugBank catalog drug-target interactions and pharmacological properties (Wishart et al., 2018), ChEMBL aggregates bioactivity data from medicinal chemistry literature (Mendez et al., 2019), and disease ontologies like the Disease Ontology and Human Phenotype Ontology provide standardized terminologies for describing diseases and phenotypes. These knowledge resources encode decades of biomedical research in machine-readable form, providing a foundation of reliable information that can ground and constrain LLM reasoning. Integration of knowledge graphs with language models can take several forms. Graph neural networks can be used to encode knowledge graph structure, with the resulting representations incorporated into language model architectures through cross-attention or concatenation (Mohamed et al., 2021). Alternatively, knowledge graph information can be serialized into text and provided as context to the language model, leveraging the model’s text understanding capabilities to reason about structured relationships. Retrieval-augmented approaches retrieve relevant knowledge graph triples based on the input query and include them in the model context, combining the flexibility of language models with the reliability of curated knowledge sources.

Retrieval-augmented generation (RAG) represents a particularly promising approach for knowledge enhancement of LLMs (Lewis et al., 2020; Zakka et al., 2024). Rather than relying solely on knowledge encoded in model parameters during pretraining, RAG systems retrieve relevant documents or knowledge base entries at inference time and include them in the model’s context. This approach offers several advantages for biomedical applications: it enables access to current information beyond the model’s training cutoff, reduces hallucination by grounding outputs in retrieved evidence, provides transparency through citation of sources, and can be updated simply by changing the retrieval corpus without model retraining (Hays and Richardson, 2026a). Almanac demonstrated the effectiveness of RAG for clinical medicine, using retrieval over medical guidelines and literature to ground clinical recommendations in authoritative sources (Zakka et al., 2024). Benchmarking studies have confirmed that RAG substantially improves accuracy on biomedical question answering tasks while reducing factual errors (Xiong et al., 2024).

2.6 Zero-shot and few-shot learning

A distinguishing capability of modern LLMs is their ability to perform zero-shot and few-shot learning, making accurate predictions on novel tasks with minimal or no task-specific training examples (Brown et al., 2020; Kojima et al., 2022). This capability emerges from large-scale pretraining, which equips models with broad world knowledge and general-purpose reasoning abilities that can be applied to new situations through appropriate prompting. For biomedical applications, this capability is particularly valuable given the many scenarios where labeled data is scarce or expensive to obtain. Zero-shot learning enables LLMs to perform tasks they have never explicitly been trained on, guided only by natural language descriptions of the task (Kojima et al., 2022). For example, a model might be prompted to classify whether a clinical note indicates a diagnosis of diabetes, without ever having been trained on diabetes classification specifically. The model draws on its general understanding of medical terminology and the relationship between symptoms, tests, and diagnoses to perform the task. Studies have demonstrated that large language models can achieve impressive zero-shot performance on medical licensing examinations, clinical reasoning benchmarks, and biomedical question answering tasks (Singhal et al., 2023; Nori et al., 2023; Kung et al., 2023). Few-shot learning extends this capability by providing a small number of examples in the prompt that demonstrate the desired input-output mapping (Brown et al., 2020). These examples guide the model toward producing outputs in the desired format and help disambiguate task requirements. Few-shot prompting has proven particularly effective for structured prediction tasks where the output format might be ambiguous from the task description alone. In biomedical contexts, few-shot learning enables rapid adaptation to new prediction tasks without the need for large labeled datasets or model fine-tuning. Chain-of-thought prompting represents an important advancement that improves LLM reasoning on complex tasks by encouraging the model to produce intermediate reasoning steps before reaching a final answer (Wei et al., 2022). Rather than producing an answer directly, the model is prompted (through instructions or examples) to show its work, breaking down complex problems into smaller steps that can be verified. This approach has been shown to substantially improve performance on tasks requiring multi-step reasoning, mathematical calculation, or logical inference. For biomedical applications, chain-of-thought prompting can improve performance on clinical reasoning tasks and provide transparency into the model’s decision-making process, though the generated reasoning chains do not always faithfully reflect the model’s internal computations.

3 Large language models in drug discovery

Drug discovery is a complex, multistage process encompassing target identification, hit discovery, lead optimization, preclinical testing, and clinical trials, typically requiring over a decade of effort and billions of dollars in investment before a new therapeutic reaches patients (DiMasi et al., 2016; Wouters et al., 2020). The high attrition rate at each stage, with approximately 90% of candidates failing in clinical trials, underscores the need for improved computational methods that can more accurately predict drug efficacy, safety, and pharmacokinetic properties early in the discovery process (Vamathevan et al., 2019; Paul et al., 2021). Large language models are being applied across this entire pipeline, offering the potential to accelerate timelines, reduce costs, and improve success rates by leveraging patterns learned from vast amounts of biomedical data (see Figures 4–8 for a quantitative overview of architectures, application domains, benchmarks, openness, and reported performance across the 102-model corpus considered in this review). This section examines key applications of LLMs in drug discovery, from early-stage target identification through lead optimization and beyond.

Architectural and scale landscape of LLMs for drug discovery and precision medicine. Scatter of release year against l o g 10 parameter count (in billions) for the 59 models in our 102-model corpus that report a parameter count. Colour encodes architecture family (encoder-only, decoder-only, encoder-decoder); marker shape encodes open-versus closed-source release (X markers denote closed-source releases). Every plotted model is individually labelled; labels are automatically de-overlapped and connected to their marker by a thin leader line where displaced. The plot makes two dataset-level trends explicit: (i) the architectural shift from encoder-dominant early biomedical models (e.g., BioBERT, ChemBERTa, ESM-2) to decoder-dominant 2023–2025 frameworks, and (ii) the bimodal scale distribution, with most domain-adapted models clustered below 10 B parameters while a small frontier exceeds 10 2 B. Data drawn from the evolutionary-tree corpus (Figure 3) cross-referenced with Song et al. (2025) and the original publications.
Figure 4. Architectural and scale landscape of LLMs for drug discovery and precision medicine. Scatter of release year against l o g 10 parameter count (in billions) for the 59 models in our 102-model corpus that report a parameter count. Colour encodes architecture family (encoder-only, decoder-only, encoder-decoder); marker shape encodes open-versus closed-source release (X markers denote closed-source releases). Every plotted model is individually labelled; labels are automatically de-overlapped and connected to their marker by a thin leader line where displaced. The plot makes two dataset-level trends explicit: (i) the architectural shift from encoder-dominant early biomedical models (e.g., BioBERT, ChemBERTa, ESM-2) to decoder-dominant 2023–2025 frameworks, and (ii) the bimodal scale distribution, with most domain-adapted models clustered below 10 B parameters while a small frontier exceeds 10 2 B. Data drawn from the evolutionary-tree corpus (Figure 3) cross-referenced with Song et al. (2025) and the original publications.
Domain-coverage matrix of LLMs over time. Heatmap showing how many models in the 102-model corpus address each application category (rows: Foundational, Biomedical, Clinical, Protein, Genomic, Single-cell, Molecular, Drug Discovery, Multi-functional) within each year band (columns: 2018–2020, 2021–2022, 2023, 2024, 2025). Cell values are model counts; right marginal bars give row totals, bottom marginal bars give yearly totals. The figure makes two patterns explicit: (i) drug-discovery and multi-functional models dominate releases from 2023 onward, accounting for most of the post-2023 growth, and (ii) earlier years are dominated by foundational, biomedical, and protein models, mirroring the architectural shift seen in Figure 4. Categories are taken from the evolutionary-tree corpus; counts are exact and not imputed.
Figure 5. Domain-coverage matrix of LLMs over time. Heatmap showing how many models in the 102-model corpus address each application category (rows: Foundational, Biomedical, Clinical, Protein, Genomic, Single-cell, Molecular, Drug Discovery, Multi-functional) within each year band (columns: 2018–2020, 2021–2022, 2023, 2024, 2025). Cell values are model counts; right marginal bars give row totals, bottom marginal bars give yearly totals. The figure makes two patterns explicit: (i) drug-discovery and multi-functional models dominate releases from 2023 onward, accounting for most of the post-2023 growth, and (ii) earlier years are dominated by foundational, biomedical, and protein models, mirroring the architectural shift seen in Figure 4. Categories are taken from the evolutionary-tree corpus; counts are exact and not imputed.
Benchmark and dataset usage across the LLM corpus. Horizontal stacked bar chart showing, for each evaluation benchmark or dataset used by ≥ 2 of the 102 models in our corpus, the number of models that report using it. Stacking colours indicate whether the user model belongs to the drug-discovery, precision-medicine, or foundational/general class. Benchmarks used by exactly one model are aggregated into the top row (“Other”). The figure highlights MoleculeNet, ChEMBL, PubChem, ZINC and MedQA as the most frequently reused evaluation resources, and exposes the marked split between molecular benchmarks (predominantly drug-discovery) and clinical-QA benchmarks (predominantly precision-medicine), with limited overlap. Counts are taken from the per-model evaluation columns in Tables 1, 2; no usage entries are imputed.
Figure 6. Benchmark and dataset usage across the LLM corpus. Horizontal stacked bar chart showing, for each evaluation benchmark or dataset used by ≥ 2 of the 102 models in our corpus, the number of models that report using it. Stacking colours indicate whether the user model belongs to the drug-discovery, precision-medicine, or foundational/general class. Benchmarks used by exactly one model are aggregated into the top row (“Other”). The figure highlights MoleculeNet, ChEMBL, PubChem, ZINC and MedQA as the most frequently reused evaluation resources, and exposes the marked split between molecular benchmarks (predominantly drug-discovery) and clinical-QA benchmarks (predominantly precision-medicine), with limited overlap. Counts are taken from the per-model evaluation columns in Tables 1, 2; no usage entries are imputed.
Open-versus closed-source landscape of LLMs for drug discovery and precision medicine. **(A)** Stacked bar of release year against the number of models released, decomposed into open-source (green) and closed-source (pink) releases across the 102-model corpus. The dataset is overwhelmingly open (95/102 models), with most closed-source contributions concentrated in 2022–2024 from large industrial labs. **(B)** Top contributing organisations/institutions, drawn from the per-model source attribution of the same corpus; bars are stacked by open versus closed contributions and labelled with totals. “Academic” aggregates university or hospital first-author contributions where no single industrial lead is identifiable. The figure highlights the dominance of academic and Meta/Google contributions and the relative scarcity of closed-source releases outside a small set of large industrial actors.
Figure 7. Open-versus closed-source landscape of LLMs for drug discovery and precision medicine. (A) Stacked bar of release year against the number of models released, decomposed into open-source (green) and closed-source (pink) releases across the 102-model corpus. The dataset is overwhelmingly open (95/102 models), with most closed-source contributions concentrated in 2022–2024 from large industrial labs. (B) Top contributing organisations/institutions, drawn from the per-model source attribution of the same corpus; bars are stacked by open versus closed contributions and labelled with totals. “Academic” aggregates university or hospital first-author contributions where no single industrial lead is identifiable. The figure highlights the dominance of academic and Meta/Google contributions and the relative scarcity of closed-source releases outside a small set of large industrial actors.
Reported-performance landscape across task categories. Strip plot of reported numerical evaluation metrics drawn from Tables 1, 2 (*n* = 18 models with a quantitative metric in our master dataset). Each point is one model whose original publication or the Song et al. overview (Song et al., 2025) reports a numerical metric value; point colour encodes architecture family and marker shape encodes open-versus closed-source. Tasks are ordered along the y-axis by ascending median metric. Because reported metric *types* differ across rows (MedQA accuracy, F1, validity, ROC-AUC, BLEU, pLDDT, top-1 accuracy), values are not directly comparable across tasks. The figure is intentionally sparse: models for which we could not locate a quantitative metric in the cited tables are not plotted.
Figure 8. Reported-performance landscape across task categories. Strip plot of reported numerical evaluation metrics drawn from Tables 1, 2 (n = 18 models with a quantitative metric in our master dataset). Each point is one model whose original publication or the Song et al. overview (Song et al., 2025) reports a numerical metric value; point colour encodes architecture family and marker shape encodes open-versus closed-source. Tasks are ordered along the y-axis by ascending median metric. Because reported metric types differ across rows (MedQA accuracy, F1, validity, ROC-AUC, BLEU, pLDDT, top-1 accuracy), values are not directly comparable across tasks. The figure is intentionally sparse: models for which we could not locate a quantitative metric in the cited tables are not plotted.

3.1 Target identification and validation

Target identification, the process of determining which biological molecules should be modulated to treat a disease, represents a critical early step in drug discovery that fundamentally shapes the trajectory of a drug development program (Vamathevan et al., 2019; Santos et al., 2017). The ideal drug target is causally involved in disease pathophysiology, druggable with small molecules or biologics, and amenable to selective modulation without unacceptable side effects. Traditional approaches to target identification rely on genetic studies, differential expression analysis, and pathway databases, but the complexity of biological systems means that many potential targets remain undiscovered or poorly characterized.

LLMs facilitate target identification by analyzing vast amounts of biomedical literature, genomic data, and disease-gene associations to uncover novel target-disease linkages that may not be apparent from any single data source (Vamathevan et al., 2019; Stokes et al., 2020). Language models can synthesize information from thousands of publications to identify genes and proteins implicated in disease processes, even when these connections are only indirectly mentioned or must be inferred from multiple studies. By learning semantic relationships between biological entities from scientific text, these models can predict novel target-disease associations that extend beyond explicitly documented relationships. For example, a language model trained on biomedical literature might infer that a gene involved in a particular signaling pathway could be relevant to a disease affecting that pathway, even if no direct experimental link has been established. GeneGPT demonstrated the potential for augmenting language models with access to biomedical databases and tools, enabling more grounded and accurate reasoning about gene functions and disease associations (Jin et al., 2023).

Drug-target interaction (DTI) prediction represents a more focused application where the goal is to predict whether a given compound will bind to a specific target protein (Öztürk et al., 2018; Nguyen et al., 2021; Huang et al., 2021). Accurate DTI prediction is valuable both for identifying new uses for existing drugs and for prioritizing compounds in virtual screening campaigns. Traditional approaches rely on molecular docking simulations or ligand-based similarity methods, but these can be computationally expensive or limited by the availability of known ligands. Transformer-based approaches to DTI prediction have achieved state-of-the-art results by learning to embed both drug molecules and target proteins in a shared representation space (Huang et al., 2021; Chen et al., 2020). MolTrans uses a knowledge-inspired transformer to capture interaction patterns between molecular substructures and protein subsequences, outperforming previous methods on benchmark datasets including DAVIS and KIBA (Huang et al., 2021). TransformerCPI employs self-attention mechanisms to learn contextual representations of both compounds and proteins, achieving improved prediction accuracy on compound-protein interaction datasets (Chen et al., 2020). More recent work has combined transformer-based representations with graph neural networks and topological features, capturing complementary aspects of molecular structure to further improve prediction accuracy (Nguyen et al., 2021; Yazdani-Jahromi et al., 2022).

3.2 Molecular generation and design

De novo drug design, the generation of novel molecular structures with desired properties, represents one of the most exciting and potentially broad applications of LLMs in drug discovery (Bilodeau et al., 2022; Segler et al., 2018; Gómez-Bombarelli et al., 2018). Traditional medicinal chemistry relies heavily on intuition, iterative synthesis, and incremental modification of known active compounds. Generative models offer the possibility of exploring vast regions of chemical space more efficiently, potentially identifying structurally novel compounds with superior properties. By treating molecular representations as specialized languages, LLMs can learn the grammar and semantics of chemical space and generate novel, synthesizable molecules that satisfy multiple property constraints simultaneously. The SMILES representation provides a natural entry point for applying language models to molecular generation, as it encodes molecular graphs as linear strings amenable to sequence modeling (Segler et al., 2018; Bagal et al., 2022). Early work demonstrated that recurrent neural networks trained on SMILES strings could generate focused molecular libraries enriched for desired properties, with generated molecules often exhibiting structural novelty relative to training data while maintaining drug-like characteristics (Segler et al., 2018).

MolGPT applied the transformer decoder architecture to SMILES generation, demonstrating improved sample quality and property control compared to earlier recurrent approaches (Bagal et al., 2022). The model learns conditional generation, producing molecules that satisfy specified property constraints while maintaining validity and synthesizability. Variational autoencoders and related latent space approaches provide an alternative paradigm for molecular generation that enables smooth interpolation between molecules and property-directed optimization in a continuous latent space (Gómez-Bombarelli et al., 2018; Jin et al., 2018). These methods encode molecules into a low-dimensional latent representation where nearby points correspond to chemically similar molecules, then decode latent vectors back to molecular structures. Optimization in this continuous space can identify molecules with improved properties more efficiently than discrete search over molecular graphs. Junction Tree VAE addressed a key limitation of earlier VAE approaches by generating molecules as assemblies of valid substructures rather than atom-by-atom, substantially improving the validity of generated molecules (Jin et al., 2018).

More recent work has explored combining language models with other molecular representations and optimization techniques to achieve improved generation performance. DrugEx combines transformer-based generation with reinforcement learning to navigate chemical space toward molecules with desired properties, using multi-objective reward functions to balance potency, selectivity, and drug-likeness (Liu X. et al., 2023). PaccMann, an attention-based molecular generation framework that couples transcriptomic context with chemical language modelling, illustrates how such architectures can be directed toward kinase-inhibitor design tasks (Born et al., 2021), and attention-based molecular generators more broadly have been applied to EGFR inhibitor design, including efforts aimed at the 90M resistance mutation that limits the efficacy of first-generation tyrosine kinase inhibitors in non-small cell lung cancer. Similarly, transformer-based generative models have been applied to design selective JAK2 inhibitors for myeloproliferative neoplasms, producing novel scaffolds distinct from approved JAK inhibitors such as ruxolitinib while maintaining favorable pharmacokinetic properties (Born and Manica, 2023). Diffusion models have emerged as a powerful alternative paradigm for molecular generation, with approaches like DiffDock achieving state-of-the-art results for structure-based drug design by directly generating binding poses through learned diffusion processes (Corso et al., 2023; Hoogeboom et al., 2022; Xu et al., 2022). These methods can incorporate 3D structural constraints that are difficult to encode in sequence-based representations, enabling structure-based generation that accounts for the target binding site geometry.

The integration of natural language with molecular generation represents a particularly exciting recent development that promises to make generative models more accessible and controllable. By training models to generate molecules from natural language descriptions of desired properties, researchers can specify design criteria in human-readable terms rather than numerical property targets. Text-to-molecule models can translate descriptions like “a selective inhibitor of kinase X with good oral bioavailability” into molecular candidates, leveraging the semantic understanding encoded in language models (Liu S. et al., 2023; Edwards et al., 2022a). This capability could democratize access to computational drug design by reducing the barrier to entry for researchers without extensive computational chemistry expertise.

3.3 Property prediction and optimization

Predicting molecular properties, including absorption, distribution, metabolism, excretion, and toxicity (ADMET) profiles, is essential for prioritizing drug candidates and avoiding late-stage failures that account for substantial attrition in clinical development (Wu et al., 2018; Yang et al., 2019; Mayr et al., 2016). A molecule may show excellent target binding affinity in biochemical assays but fail as a drug due to poor solubility, rapid metabolism, or unexpected toxicity. The ability to predict these properties computationally from molecular structure alone can guide lead optimization and reduce the number of compounds requiring expensive experimental characterization. MoleculeNet established standardized benchmarks for evaluating molecular property prediction methods across diverse tasks including physical chemistry, biophysics, and toxicity prediction (Wu et al., 2018). This benchmarking effort revealed that while traditional fingerprint-based methods remained competitive on some tasks, graph neural networks and transformer-based approaches achieved state-of-the-art results on many prediction challenges (see Figure 6 for a corpus-wide view of which benchmarks, including the MoleculeNet sub-tasks discussed below, are most frequently used). Subsequent work has continued to improve performance through architectural innovations, pretraining strategies, and integration of multiple data modalities (Yang et al., 2019; Xiong et al., 2020).

Transformer-based molecular property prediction leverages the self-attention mechanism to learn representations that capture relevant substructure patterns for predicting specific properties (Chithrananda et al., 2020; Ross et al., 2022). ChemBERTa demonstrated that BERT-style pretraining on large SMILES corpora improves downstream property prediction by learning transferable representations of molecular structure (Chithrananda et al., 2020). Larger-scale pretraining efforts have shown that neural scaling laws apply to chemical language models, with larger models and more pretraining data consistently improving property prediction accuracy (Ross et al., 2022; Frey et al., 2023). These findings suggest that continued scaling of molecular language models may yield further improvements in predictive performance. Toxicity prediction represents a particularly important application of molecular property prediction, as unexpected toxicity accounts for a substantial fraction of drug candidate failures in clinical trials (Mayr et al., 2016). DeepTox established deep learning approaches for toxicity prediction, demonstrating that neural networks could outperform traditional quantitative structure-activity relationship (QSAR) methods on standardized toxicity prediction challenges (Mayr et al., 2016). More recent work has applied transformer architectures and language model pretraining to toxicity prediction, achieving improved accuracy particularly for rare toxicity endpoints where training data is limited. The ability of pretrained models to transfer knowledge from related tasks helps address data scarcity challenges that plague toxicity prediction for specific endpoints.

Lead optimization, the iterative process of modifying lead compounds to improve their property profiles, can be framed as a multi-objective optimization problem where the goal is to simultaneously optimize potency, selectivity, ADMET properties, and synthetic accessibility (Schneider et al., 2020; Bilodeau et al., 2022). LLMs enable optimization approaches that propose molecular modifications in natural language terms, generate molecules matching specified property profiles, or navigate property trade-offs through learned representations. By capturing the complex relationships between molecular structure and multiple properties, these models can suggest modifications more efficiently than exhaustive enumeration of chemical modifications.

3.4 Drug repurposing

Drug repurposing, the identification of new therapeutic uses for existing approved drugs, offers a faster and less expensive path to new treatments compared to de novo drug discovery (Pushpakom et al., 2019). Approved drugs have established safety profiles, manufacturing processes, and regulatory histories, substantially reducing the time and cost required to reach patients for a new indication. The COVID-19 pandemic highlighted the potential value of drug repurposing, as existing drugs were rapidly evaluated for potential activity against the novel coronavirus (Zhou et al., 2020; Zeng et al., 2020; Gysi et al., 2021). LLMs facilitate drug repurposing by analyzing diverse data sources to identify unexpected connections between existing drugs and new indications. By synthesizing information from scientific literature, clinical records, molecular databases, and knowledge graphs, these models can identify drugs whose mechanisms of action might be relevant to diseases beyond their original indications (Pushpakom et al., 2019; Zhou et al., 2020). For example, a language model might identify that a drug approved for one inflammatory condition shares mechanistic features with another inflammatory disease, suggesting potential repurposing even if no direct clinical evidence exists.

Network medicine approaches to drug repurposing leverage knowledge graphs representing relationships between drugs, targets, diseases, and biological pathways to identify repurposing opportunities through network proximity analysis (Gysi et al., 2021; Zitnik et al., 2018). Drugs whose targets are close in the interactome to disease-associated genes may have therapeutic potential for those diseases. LLMs can enhance these approaches by extracting relationships from unstructured text to populate knowledge graphs, resolving entity ambiguities, and integrating information from multiple sources. The combination of structured network analysis with language model capabilities for processing unstructured text enables more comprehensive identification of repurposing candidates. Adverse event databases and electronic health records provide another source of repurposing insights, as drugs sometimes produce unexpected beneficial effects in patient populations (Tatonetti et al., 2012). Data-driven analysis of side effect profiles has revealed unexpected drug-disease connections that have been validated in subsequent clinical studies. LLMs can process unstructured clinical notes to identify potential therapeutic effects that may not be captured in structured fields, expanding the scope of data-driven repurposing discovery. Notable successes in AI-driven drug repurposing include the identification of baricitinib, a JAK1/JAK2 inhibitor originally approved for rheumatoid arthritis, as a potential COVID-19 therapeutic through knowledge graph analysis of host-pathogen interactions (Richardson et al., 2020). This prediction was subsequently validated in clinical trials, leading to emergency use authorization. Similarly, network-based approaches identified sildenafil as a candidate for Alzheimer’s disease prevention, with a retrospective observational analysis of insurance claims data reporting an approximately 69% lower incidence of Alzheimer’s disease among individuals prescribed the drug (Fang et al., 2021); this association arises from non-randomized real-world data and is subject to residual confounding, and prospective randomized validation is still needed to establish a causal protective effect.

3.5 Multi-agent systems for integrated drug discovery

Recent advances have moved beyond single-task models toward multi-agent systems in which specialized LLM-based agents handle different stages of discovery (literature review, hypothesis generation, molecular design, property prediction, and experiment planning), coordinated by orchestration mechanisms that manage information flow across agents (Park et al., 2023; Wang et al., 2024). Tool-augmented agents such as ChemCrow (Bran et al., 2024), autonomous chemical research platforms that close the loop with robotic synthesis (Boiko et al., 2023), and industrial end-to-end campaigns exemplified by Insilico Medicine’s AI-driven kinase inhibitor programs (Zhavoronkov et al., 2019; Xu et al., 2025) illustrate how these ideas scale from individual tasks to integrated pipelines. A detailed treatment of these systems, together with representative case studies and their reported outcomes, is provided in Section 6.1.

3.6 Benchmarks and evaluation

Rigorous evaluation is essential for assessing progress in LLM-based drug discovery and identifying areas requiring further development. The field has developed standardized benchmarks covering diverse tasks including property prediction, molecular generation, and drug-target interaction prediction (Wu et al., 2018; Polykovskiy et al., 2020). MoleculeNet provides comprehensive benchmarks for molecular property prediction spanning physical chemistry, biophysics, physiology, and toxicology (Wu et al., 2018). The benchmark includes standardized data splits and evaluation protocols that enable fair comparison across methods. Performance on MoleculeNet tasks has improved substantially with the development of graph neural networks, transformers, and pretrained molecular representations.

The MOSES benchmarks evaluate molecular generation methods on metrics including validity (fraction of generated molecules that are chemically valid), uniqueness (diversity of generated molecules), novelty (fraction not present in training data), and similarity to reference compounds (Polykovskiy et al., 2020). These metrics capture different aspects of generation quality that are important for drug discovery applications. Distribution learning metrics assess whether generated molecules follow the same statistical patterns as training molecules, while goal-directed metrics evaluate the ability to generate molecules with specific desired properties. Evaluation of DTI prediction methods typically employs benchmark datasets such as DAVIS, KIBA, and BindingDB, with performance measured by area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), or mean squared error for binding affinity prediction (Öztürk et al., 2018; Huang et al., 2021). Cold-split evaluation protocols, where test sets contain compounds or targets not seen during training, provide more realistic assessments of model generalization to novel chemical or biological entities (Yazdani-Jahromi et al., 2022). Performance in these challenging settings is particularly relevant for drug discovery applications where the goal is often to identify novel compounds acting on previously undrugged targets.

4 Large language models in precision medicine

Precision medicine aims to tailor medical treatment to individual patient characteristics, including genetic makeup, molecular profiles, lifestyle factors, and environmental exposures, moving beyond one-size-fits-all approaches toward therapies optimized for specific patient subgroups or individuals (Esteva et al., 2019; Rajkomar et al., 2018). Realizing this vision requires integrating diverse data types across multiple scales of biological organization, from genomic variants and transcriptomic profiles to clinical phenotypes and treatment histories. The inherent complexity of this integration challenge, combined with the unstructured nature of much clinical data, makes precision medicine a natural application domain for large language models. LLMs are transforming precision medicine by enabling more sophisticated analysis of patient data, more accurate prediction of treatment responses, and more personalized clinical decision support systems that can synthesize information from multiple sources to guide therapeutic choices.

4.1 Clinical decision support

Clinical decision support systems (CDSS) assist healthcare providers in making evidence-based decisions by analyzing patient data in the context of medical knowledge, clinical guidelines, and population-level evidence (Esteva et al., 2019; Rajkomar et al., 2018; Shickel et al., 2018). Traditional CDSS rely on rule-based systems that encode explicit clinical logic, but these approaches struggle to incorporate the nuanced, context-dependent reasoning that characterizes expert clinical judgment. LLMs enhance CDSS capabilities by processing unstructured clinical narratives that contain rich information often absent from structured data fields, integrating diverse data sources including notes, laboratory results, imaging reports, and external knowledge bases, and providing contextualized recommendations that account for patient-specific factors. The ability of LLMs to process unstructured clinical text represents a particularly important capability for clinical decision support. Electronic health records contain extensive narrative documentation, including admission notes, progress notes, discharge summaries, and consultation reports, that capture clinical reasoning, contextual details, and subtle findings that may not be coded in structured fields (Shickel et al., 2018; Si et al., 2021). Studies have demonstrated that LLMs can extract clinically relevant information from these narratives, including diagnoses, medications, procedures, and clinical status, with accuracy approaching or exceeding that of human reviewers (Patel and Lam, 2023). This capability enables decision support systems that consider the full clinical picture rather than relying solely on structured data elements.

Med-PaLM and its successor Med-PaLM 2 demonstrated that large language models can achieve expert-level performance on medical question answering and clinical reasoning tasks when appropriately adapted to the medical domain (Singhal et al., 2023). On the MedQA benchmark, which contains questions from medical licensing examinations, Med-PaLM 2 achieved accuracy exceeding that of average physicians, demonstrating the potential for LLMs to support complex medical reasoning. Importantly, the model’s responses were evaluated not only for accuracy but also for factors critical to clinical utility, including the quality of explanations, potential for harm, and alignment with medical consensus. These evaluations revealed both strengths and limitations, with the model occasionally producing plausible-sounding but incorrect information, highlighting the importance of human oversight in clinical applications. Retrieval-augmented approaches to clinical decision support address concerns about hallucination and currency of medical knowledge by grounding LLM outputs in retrieved evidence from authoritative sources (Zakka et al., 2024; Xiong et al., 2024). Almanac demonstrated this approach for clinical medicine, retrieving relevant passages from medical guidelines, textbooks, and literature to support clinical question answering (Zakka et al., 2024). By explicitly citing sources and constraining outputs to retrieved evidence, these systems provide transparency that enables clinicians to verify recommendations and maintain appropriate skepticism toward AI-generated content. Benchmarking studies have confirmed that retrieval augmentation substantially improves factual accuracy while reducing hallucinations on biomedical question answering tasks (Xiong et al., 2024). In cardiology, LLM-based systems have been deployed to interpret electrocardiograms and suggest diagnoses for arrhythmias, achieving performance comparable to cardiologists in detecting atrial fibrillation, left ventricular dysfunction, and hypertrophic cardiomyopathy (Attia et al., 2019; Noseworthy et al., 2020). Complementary computational approaches, such as mechanistic simulations of cardiac extracellular matrix remodeling, provide biophysical foundations that can inform and validate AI-driven predictions in cardiovascular applications (Hays and Richardson, 2026b). For diabetes management, AI-driven decision support systems analyzing continuous glucose monitoring data, insulin dosing history, and dietary patterns have demonstrated improved glycemic control in type 1 diabetes patients compared to standard care (Tyler et al., 2020).

4.2 Patient stratification and treatment personalization

Patient stratification, the process of grouping patients based on characteristics that predict treatment response or disease prognosis, is fundamental to precision medicine and guides both clinical trial design and therapeutic decision making (Esteva et al., 2019). Traditional stratification approaches rely on individual biomarkers or clinical characteristics, but the multifactorial nature of treatment response often requires integration of multiple data types to achieve optimal predictive performance. LLMs enable more sophisticated stratification by learning complex patterns from multi-modal patient data, including genomic profiles, transcriptomic signatures, clinical histories, and lifestyle factors, that together determine treatment outcomes. Single-cell analysis has emerged as a powerful approach for understanding cellular heterogeneity in disease and treatment response, but the high dimensionality and complexity of single-cell data present analytical challenges (Cui et al., 2024; Lotfollahi et al., 2019; Theodoris et al., 2023). scGPT applies transformer architectures to single-cell transcriptomics, learning representations that capture cell state, type, and perturbation responses from large-scale single-cell atlases (Cui et al., 2024). These learned representations enable prediction of cellular responses to drugs and genetic perturbations, identification of cell types and states, and integration of data across experimental batches. Geneformer demonstrated that transformer models pretrained on large-scale single-cell data can transfer learned representations to downstream tasks including disease state classification, drug response prediction, and network analysis (Theodoris et al., 2023). scGen showed that generative models could predict single-cell perturbation responses, enabling in silico exploration of how cells respond to drugs or genetic modifications (Lotfollahi et al., 2019).

Drug sensitivity prediction at the single-cell level represents a particularly promising application for precision oncology, where tumor heterogeneity often underlies treatment resistance and relapse. By analyzing gene expression patterns in individual cancer cells, models can identify resistant subpopulations that may persist despite initial treatment response and require alternative therapeutic strategies. Integration of single-cell transcriptomics with language models trained on drug mechanism information enables prediction of which cells will respond to which drugs, potentially guiding selection of combination therapies that address multiple resistant populations. Drug synergy prediction addresses the challenge of identifying combination therapies that exhibit synergistic effects, where the combined effect exceeds the sum of individual drug effects (Preuer et al., 2018; Menden et al., 2019). Predicting synergy is challenging because it depends on complex interactions between drug mechanisms, target pathways, and cellular context. DeepSynergy represented a breakthrough in this area, introducing a deep neural network architecture that integrates chemical descriptors of drug pairs with genomic features of cancer cell lines to predict synergy scores (Preuer et al., 2018). By learning joint representations of drug chemistry and cellular context, DeepSynergy achieved superior predictive performance compared to kernel methods, random forests, and gradient boosting approaches on the NCI-ALMANAC and O’Neil benchmark datasets. More recent work has explored transformer-based approaches that can incorporate natural language descriptions of drug mechanisms to improve synergy prediction, leveraging the semantic understanding of drug action encoded in language models.

4.3 Drug recommendation and dosage optimization

Personalized drug recommendation, selecting optimal medications and dosages for individual patients based on their specific characteristics and clinical context, requires integrating patient-specific factors with pharmacological knowledge and clinical evidence (Rajkomar et al., 2018; Si et al., 2021). Factors influencing drug selection include patient comorbidities, concurrent medications, genetic variants affecting drug metabolism, renal and hepatic function, and individual preferences and circumstances. LLMs can process electronic health records, drug databases, and clinical guidelines to generate evidence-based recommendations that account for these multiple factors. Drug-drug interaction (DDI) prediction represents a critical safety consideration in drug recommendation, as concurrent use of interacting medications can cause serious adverse events (Zitnik et al., 2018; Tatonetti et al., 2012). Polypharmacy, the use of multiple concurrent medications, is common especially in elderly patients and those with multiple chronic conditions, creating complex webs of potential interactions that are difficult to track manually. Graph-based approaches have proven effective for DDI prediction by representing drugs and their relationships as networks, with interactions predicted based on network structure and drug properties (Zitnik et al., 2018). Language models can enhance these approaches by extracting interaction information from unstructured literature and regulatory documents, expanding the scope of known interactions beyond those in structured databases.

Adverse drug event prediction aims to identify patients at elevated risk for specific adverse reactions, enabling proactive monitoring or alternative drug selection (Tatonetti et al., 2012; Huang et al., 2022). Data-driven analysis of electronic health records and adverse event databases has revealed patterns linking patient characteristics, drug exposure, and adverse outcomes that can inform risk prediction. Language models can process clinical notes to identify subtle signs of emerging adverse events that may not be captured in structured diagnosis codes, potentially enabling earlier intervention.

4.4 Genomic interpretation and variant analysis

Interpreting genomic variants, determining which genetic variations are clinically relevant and how they affect disease risk, prognosis, or treatment response, represents a major bottleneck in translating genomic sequencing to clinical practice (Zhou et al., 2023; Ji et al., 2021; Dalla-Torre et al., 2023). Clinical sequencing routinely identifies thousands of genetic variants in each patient, but only a small fraction have established clinical significance, and even fewer have actionable implications for treatment. Variants of uncertain significance (VUS) represent a particular challenge, as they cannot be definitively classified as pathogenic or benign based on current evidence. DNA language models trained on genomic sequences can predict the functional consequences of genetic variants by learning sequence patterns associated with regulatory elements, splice sites, and protein function (Zhou et al., 2023; Ji et al., 2021; Nguyen et al., 2024). DNABERT learns contextual representations of DNA sequences through masked language modeling, capturing patterns that predict regulatory function and variant effects (Ji et al., 2021). These learned representations improve performance on downstream tasks including transcription factor binding prediction, promoter detection, and splice site identification. Larger-scale genomic language models trained on diverse species have demonstrated improved generalization and zero-shot performance on novel prediction tasks (Dalla-Torre et al., 2023).

RNA language models extend similar approaches to RNA sequences, with applications including splice site prediction, RNA secondary structure prediction, and post-transcriptional regulation modeling. Protein language models can predict the effects of amino acid substitutions on protein structure and function, complementing DNA-level analysis to provide a complete picture of variant consequences (Lin et al., 2023; Rives et al., 2021). The attention patterns learned by protein language models correlate with protein contact maps, suggesting that these models capture structural information relevant to predicting mutation effects. Integration of variant effect predictions with clinical phenotype information and population genetics data enables prioritization of variants for clinical review. Language models can synthesize evidence from multiple sources, including variant databases, scientific literature, and clinical case reports, to support variant classification. By processing the vast literature on genetic variants and their clinical associations, these models can identify relevant evidence more efficiently than manual curation. In hereditary cancer syndromes, LLM-based variant interpretation has been applied to BRCA1/2 variants to improve classification of variants of uncertain significance, which affect approximately 10%–20% of tested patients and create substantial clinical uncertainty regarding cancer risk and management (Tavtigian et al., 2018). For pharmacogenomic variants affecting drug metabolism, including CYP2D6 and CYP2C19 polymorphisms that influence the efficacy of antidepressants, opioids, and antiplatelet agents, language models trained on clinical outcome data have improved prediction of drug response phenotypes from genotype data (Zhou et al., 2008). In pediatric populations, genomic language models have accelerated diagnosis of rare genetic diseases, reducing the diagnostic odyssey from years to weeks for conditions such as developmental epileptic encephalopathies and inborn errors of metabolism (Clark et al., 2019).

4.5 Clinical trial matching and outcome prediction

Matching patients to appropriate clinical trials and predicting trial outcomes are critical for advancing precision medicine by ensuring that new therapies are evaluated in the patients most likely to benefit and that trials are designed efficiently to detect true effects (Wang and Sun, 2022; Yuan et al., 2019). Clinical trial matching requires understanding complex eligibility criteria, often expressed in semi-structured or natural language, and evaluating patient characteristics against these criteria. Trial outcome prediction requires integrating information about trial design, patient population, drug mechanism, and historical precedent. Natural language processing enables automated extraction and interpretation of trial eligibility criteria from ClinicalTrials.gov and other registries (Yuan et al., 2019). Criteria2Query demonstrated that language models could translate natural language eligibility criteria into structured database queries, enabling automated patient matching at scale (Yuan et al., 2019). Trial2Vec learned representations of clinical trials from their text descriptions, enabling similarity search to identify related trials and predict trial outcomes based on similar precedents (Wang and Sun, 2022). These approaches can accelerate patient recruitment by automatically screening electronic health records against trial criteria and notifying clinicians of potential matches.

Trial outcome prediction can inform go/no-go decisions in drug development by estimating the probability of trial success based on available preclinical and early clinical data. Language models can synthesize information from trial protocols, preclinical data, mechanism of action descriptions, and historical trial results to predict success probability. While such predictions carry substantial uncertainty, they can help prioritize development resources toward programs with higher success probability.

4.6 Integration of multiscale data

A defining challenge of precision medicine is integrating data across multiple scales of biological organization, from molecular level genomics, proteomics, and metabolomics through cellular level single-cell analyses to organism level clinical phenotypes and imaging (Esteva et al., 2019; Wang et al., 2023; Hays et al., 2025). Each data type provides a different perspective on patient biology, and their integration can reveal patterns not visible in any single modality. Hierarchical molecular language models conceptualize cellular signaling as a specialized molecular language, where signaling molecules function as tokens, enabling the modeling of protein interactions and their functional consequences across multiple biological scales (Hays et al., 2025). Multi-modal LLMs are particularly well suited to this integration challenge, as they can learn aligned representations across diverse data types and reason about relationships between modalities. The integration of transcriptomic data with clinical information exemplifies the potential for multiscale analysis in precision medicine. Gene expression profiles reflect cellular state and pathway activity, providing molecular insight into disease processes and drug responses. By combining transcriptomic signatures with clinical phenotypes, laboratory values, and treatment history, models can develop richer representations of patient state that improve outcome prediction. Single-cell transcriptomics adds additional resolution by revealing cellular heterogeneity obscured in bulk tissue analysis (Hays et al., 2023). Imaging data, including radiological imaging and pathology slides, provides spatial information about disease that complements molecular and clinical data. Multi-modal models that integrate imaging with other data types can leverage complementary information for improved diagnosis and prognosis. For example, combining histopathology images with genomic profiles in cancer enables more precise tumor characterization than either modality alone.

Knowledge graphs provide a framework for integrating heterogeneous data types by representing entities and relationships in a unified structure (Mohamed et al., 2021; Bonner et al., 2022). Biomedical knowledge graphs connect drugs, targets, diseases, genes, pathways, and other entities through diverse relationship types, providing a backbone for data integration. Language models can enhance knowledge graph-based integration by extracting new relationships from unstructured text, resolving entity ambiguities, and reasoning about multi-hop relationships that connect distant entities through intermediate connections.

5 Technical methodologies and architectures

The success of LLMs in drug discovery and precision medicine depends on sophisticated technical approaches that adapt general-purpose language models to biomedical domains while addressing the unique challenges of biological and clinical data. This section examines key methodologies and architectural innovations enabling these applications, providing technical depth on the computational approaches underlying the applications discussed in previous sections.

Beyond cataloguing architectures, it is important to compare them critically and to identify the trade-offs that practitioners face when choosing between encoder-only, decoder-only, encoder-decoder, graph-based, and multi-modal designs. Encoder-only models such as BERT, BioBERT, and ChemBERTa excel at representation learning for classification and extraction tasks and are typically smaller and cheaper to fine-tune, but they cannot natively generate sequences and tend to underperform on open-ended question answering or de novo molecular design. Decoder-only models such as GPT-3/4, BioGPT, and MolGPT support flexible generation and in-context learning, yet they are more prone to hallucination on biomedical facts and are harder to constrain to validated knowledge. Encoder-decoder and sequence-to-sequence models (e.g., MolT5, Chemformer) bridge these regimes for translation-style tasks such as text-to-molecule mapping and retrosynthesis, at the cost of more complex training. Graph- and 3D-aware architectures (e.g., D-MPNN, equivariant networks, DiffDock) capture molecular topology and stereochemistry that linearised SMILES cannot, but they are less compatible with natural-language interfaces and require specialised data pipelines. Multi-modal systems (e.g., InstructMol, Galactica, BiomedGPT) unify these modalities at the price of substantially increased training data and compute. In short, no single architecture dominates across drug-discovery and precision-medicine tasks, and our subsequent discussion of representative models is framed around this trade-off space rather than as a ranking exercise. Tables 1, 2 make these comparisons explicit and tie reported metrics back to specific datasets and limitations.

TABLE 1. Expanded comparative summary of representative LLM-based frameworks used in drug discovery.

ModelYearBase LLMParamsTaskDatasetMetricLimitationRef.
LORE2024GPT-3.5-turbon.r.Disease-gene association prediction; PMKB-CV knowledge graphPubMed abstracts, PMKB-CV, ClinVar90% mAP across 2,097 diseases; 200× ClinVar coverageLiterature-only; no clinical validation; closed APISong et al. (2025), Li et al. (2024a)
GP-GPT2024LLaMA + LoRA/QLoRA7B/8B/70BGene-phenotype association miningdbGaP, UniProt, DisGeNet, NCBI, OMIMApproaches/exceeds GPT-4 on gene-disease retrieval (reported)Literature-based; model weights not publicly released; no clinical validationSong et al. (2025), Lyu et al. (2024)
BioGPT (target use)2023GPT-2 decoder347M/1.5BDisease target identification from PubMed/NIH grantsPubMed abstracts, NIH grant abstractsSOTA on PubMedQA at release; F1 gains on BC5CDR/KD-DTIHallucinations on OOD clinical queries; weak on rare diseasesLuo et al. (2022), Song et al. (2025)
DrugGPT2023GPT-2 decodern.r.Ligand generation for specific protein targetsBindingDB, PDBbind-cn, BioLIP, BindingMOAD, ZINC20High docking-pose recovery vs. random baselines (reported)SMILES-only; no 3D geometry; docking-only evaluationSong et al. (2025), Li et al. (2023)
MolGPT2022GPT-style decoder∼6MDe novo SMILES generation; conditional designMOSES, GuacaMol∼98% validity; ∼100% uniquenessSequence-only; limited target conditioning; small modelBagal et al. (2022), Polykovskiy et al. (2020)
FragGPT2024GPT-2 decodern.r.Fragment-based molecular generationPubChem, ChEMBLImproved fragment validity vs. atom baselines (qualitative)Fragment library bias; in silico onlySong et al. (2025), Yue et al. (2024)
Chemlactica/Chemma2024Galactica, Gemma-2B125M/1.3B/2BProperty prediction and generationPubChemCompetitive with Galactica-1.3B on chemistry tasks (reported)Small-scale; limited reasoning; English-centricSong et al. (2025), Guevorguian et al. (2024)
DrugAssist2024Llama-2-7B-Chat7BInteractive lead-compound optimisationMolOpt-Instructions, ChEMBLImproved QED/SA over baselines (in silico)In silico only; no wet-lab confirmationSong et al. (2025), Ye et al. (2024)
ChatMol2024Llama-3 + general LLM8BInteractive molecule editing/designZINC250k, MOSESHigh validity on MOSES (reported)Closed weights; in silico metrics onlySong et al. (2025), Zeng et al. (2024)
MOLLEO2025GPT-4/BioT5/MoleculeSTMn.r.Multi-objective molecular optimisationZINC, PubChemPareto-front coverage gains (reported)API-dependent; reproducibility issues from closed componentsSong et al. (2025), Wang et al. (2025a)
MultiMol2025General LLM (multi-modal)n.r.Multi-modal molecular reasoningPubChem, RCSB PDBImproves over single-modality baselines (reported)Compute-heavy; multi-modal alignment needs curated pairsSong et al. (2025), Yu et al. (2025)
PEIT-LLM2025LLaMa3.1–8B, Qwen2.5–7B7B/8BProperty-conditioned molecule generation (logP, MW)ZINCMulti-constraint generation feasible (reported)Property scoring only; no in vivo validationSong et al. (2025)
SynLlama2025Llama-3.1–8B, Llama-3.2-1B1B/8BSynthesisable molecule design with reaction routesChEMBL, EnamineImproves hit-to-lead optimisation (reported)Reaction-template coverage limited; no clinical follow-upSong et al. (2025), Sun et al. (2025)
NovoMolGen2025Self-designed transformer32M/157M/300MDe novo molecular foundation modelZINC-22Competitive validity/diversity vs. MolGPT (reported)Limited public benchmarking vs. MOSES/GuacaMolSong et al. (2025), Chitsaz et al. (2025)
TSMMG2024GPT-2 small backbone117MTarget-aware SMILES generationPubChemImprovements in target-conditioned validity (reported)Small backbone limits chemical diversitySong et al. (2025)
DrugChat2023Vicuna-13B + GNN soft prompt13BConversational QA about drug mechanisms/usesChEMBL, PubChemQualitative dialog evaluationNo quantitative benchmark; hallucination riskSong et al. (2025), Liang et al. (2023)
GPT-MolBERTa2023ChatGPT + RoBERTan.r.Property prediction via ChatGPT-augmented textMoleculeNetNear-SOTA on ESOL solubility (reported)API dependency; closed text-augmentation pipelineSong et al. (2025)
LLM4SD2023General LLMn.r.Scientific-discovery property predictionMoleculeNetGains via prompted hypothesis generation (reported)Prompt-engineering brittle; closed evaluationSong et al. (2025)
MoleculeGPT2024LLaMA-27BMulti-task molecular reasoningChEMBL, MoleculeNetCompetitive with task-specific baselines (reported)Domain transfer limited; English-only descriptionsSong et al. (2025)
LLM-MPP2025LLaMA-38BMolecular property predictionMoleculeNetImprovements on MoleculeNet sub-tasks (reported)Underperforms graph models on regression endpointsSong et al. (2025)
MolProphecy2025LLaMA-3 + ChatGPTn.r.LLM-assisted property predictionMoleculeNetGains via ensemble prompting (reported)API-coupled; reproducibility limitedSong et al. (2025), Zhao et al. (2025)
MolRAG2025General LLM + RAGn.r.Retrieval-augmented property predictionMoleculeNetImproves over base LLM via literature retrieval (reported)Bound by retrieval-corpus qualitySong et al. (2025), Xian et al. (2025)
CoTox2025GPT-4o, Gemini-2.5-Pro + CoTn.r.Six-category organ toxicity predictionUniToxAvg. F1 ≈ 0.700 vs. XGBoost/ChempropAPI costs; closed models; limited external validationSong et al. (2025), Park et al. (2025)
ChemBERTa-22022RoBERTa encoder45MMolecular property predictionMoleculeNet (BBBP, Tox21, ClinTox)ROC-AUC 0.74–0.86 (task-dependent)Underperforms D-MPNN on regression; SMILES-onlyAhmad et al. (2022), Wu et al. (2018)
TransformerCPI2020Transformer encodern.r.Drug-target/compound-protein interactionBindingDB, human/C. elegansAUC gains over CNN baselines; label-reversal controlCold-split generalisation issues; leakage riskChen et al. (2020)
DrugReAlign2024General LLM (GPT-4)n.r.Drug repurposing via prompt + dockingRCSB PDB, NR, GPCR, BindingDBRecovers known repurposing pairs; docking-validatedDocking-only; no prospective clinical validationSong et al. (2025), Wei et al. (2024)
DrugAgent2025General LLM (multi-agent)n.r.DTI prediction with multi-agent reasoningDrugBank, CTD, STITCH, DGIdb∼45% F1 improvement on kinase-inhibitor benchmarkOrchestration overhead; prompt-design brittlenessSong et al. (2025), Inoue et al. (2025)
DDI-GPT2024BioGPT-2n.r.Drug-drug interaction predictionTWOSIDESAUROC 0.964 (sentence-tree input)Retrospective benchmark; risk of label leakageSong et al. (2025), Xu et al. (2024)
CBR-DDI2025General LLM + case retrievaln.r.DDI prediction by analogical reasoningDrugBank, TWOSIDESGains over DDI-GPT; plug-and-play unseen drugsNo prospective clinical validation; corpus biasSong et al. (2025), Liu et al. (2025)
LLM-DDI2024GPT + ada-002 embeddingsn.r.DDI predictionOGB-biokg, OGB-ddiAUC gains over knowledge-graph baselines (reported)Closed embeddings; reproducibility limitedSong et al. (2025), Li et al. (2024b)
DDI-JUDGE2025General LLM + GPT-4 disc.n.r.DDI mechanism reasoningDrugBank 3.0, Human Protein Ref., SIDERImproved transparency over black-box baselines (qualitative)Hand-crafted discriminator; no clinical follow-upSong et al. (2025)
ChemCrow2023GPT-4 + 18 expert tools- (GPT-4)End-to-end synthesis planning agentInternal RoboRXN tasksSuccessful synthesis of DEET, three catalystsClosed evaluation; hand-crafted safety filters; costBran et al. (2024)
ChemDFM2024LLaMA13BMulti-task chemistry foundation modelChem. literature, PubChem, MoleculeNet, USPTOCompetitive on MoleculeNet; strong on USPTO reactionsHigh pretraining cost; small-molecule centricSong et al. (2025), Zhao et al. (2024)
ChemFM2025Self-designed LLaMA-style3BFoundation model for drug screening and generationUniChem (178M SMILES)Versatile across screening/generation (reported)Limited reaction reasoning; closed evaluationsSong et al. (2025), Cai et al. (2025)
Tx-LLM2024PaLM-2 backbone- (PaLM-2)Multi-task therapeutics across 66 TDC endpointsTDC 2.0Competitive across >60 TDC tasks (reported)Closed weights; no clinical-validation dataSong et al. (2025), Chaves et al. (2024)
TxGemma2025Gemma-22B/9B/27BOpen therapeutics foundation modelTDC 2.0Open competitive baseline across TDC (reported)No prospective validation; limited safety auditingSong et al. (2025), Wang et al. (2025b)
Token-Mol 1.02024Self-designed (token-based)n.r.Multi-task molecular generation and propertyGEOM, CrossDock2020, RCSB PDB, ChEMBL30Strong validity/uniqueness on GEOM (reported)3D conformer coverage limited; closed-sourceSong et al. (2025)
GIT-Mol2023Self-designed multi-modal700MGraph-image-text molecular foundationPubChem, ChEBI-20, MoleculeNetCross-modal retrieval and property tasks (reported)Multi-modal alignment expensive; benchmark coverage smallSong et al. (2025)
Molecular Transformer2019Encoder-decoder Transformer∼12MForward reaction prediction; retrosynthesisUSPTO_MIT, USPTO_STEREOTop-1 accuracy ≈ 90% on USPTO_MITSMILES-only; limited stereochemistry; restricted reactionsSchwaller et al. (2019)
MolT52022T5 encoder-decoder80M/250M/770MText-to-molecule and molecule-to-text translationChEBI-20BLEU ≈ 0.61 (caption); validity >80% (gen.)Sequence-only; limited 3D and reaction reasoningEdwards et al. (2022a), Edwards et al. (2022b)

Columns capture model name, release year, base LLM/architecture, parameter count (“n.r.” indicates not reported), drug-discovery task, evaluation dataset (s), reported metric where stated, and documented limitations. Rows are drawn primarily from Tables 2–7 of the recent overview by Song et al. (2025) and cross-checked against the original publications cited where available. Entries marked with “-” for parameters or metric indicate values not reported in the source. This list is non-exhaustive.

TABLE 2. Expanded comparative summary of representative LLM-based frameworks used in precision medicine.

ModelYearArch.ParamsTaskDatasetMetricLimitationRef.
BioBERT2020BERT encoder110MBiomedical NER, relation extractionPubMed; BC5CDR, NCBI-Disease, JNLPBAF1 ≈ 0.89–0.92 on biomedical NEREnglish-only; struggles with informal EHR textLee et al. (2020)
PubMedBERT2021BERT encoder (from scratch)110MBiomedical NLP benchmarksPubMed (BLURB benchmark)New SOTA on BLURB at releaseAbstract-only pretraining; weak on full-text clinical notesGu et al. (2021)
ClinicalBERT2019BERT encoder110MClinical NER, EHR phenotypingMIMIC-III notes; i2b2/n2c2 benchmarksF1 ≈ 0.89–0.92 on i2b2/n2c2 NERICU-skewed; not validated for outpatient/multilingualAlsentzer et al. (2019)
BioGPT2022GPT-2 decoder347M/1.5BBiomedical generation, QAPubMedQA, BC5CDR, KD-DTISOTA on PubMedQA at release (reported)Hallucinations on OOD clinical queriesLuo et al. (2022)
GatorTron2022Megatron-style encoder345M/3.9B/8.9BClinical NLP, EHR concept extractionUF Health >90B-word corpus; i2b2-2010, n2c2-2019SOTA on clinical NER, similarity, NLI, MedNLIHealth-system-specific; transfer to other EHRs requires fine-tuneYang et al. (2022)
ClinicalT52023T5 encoder-decoder220MClinical summarisation, classification, QAMIMIC-III, n2c2Competitive with ClinicalBERT; gains on generation tasksLimited evaluation outside English ICU notesHernandez et al. (2023)
BioMedLM2024GPT-style decoder2.7BBiomedical QA, exam-style reasoningMedQA, MedMCQA, PubMedQAMedQA ≈ 50.3% (zero-shot, 2.7B)Smaller than frontier clinical LLMs; limited safety auditingBolton et al. (2024)
Med-PaLM2023PaLM-540B + instr. tuning540BMedical QA, consumer-health responsesMultiMedQA (MedQA, MedMCQA, PubMedQA, LiveQA)MedQA 67.2% (passing-level)Closed-source; English-centric; skewed to US board contentSinghal et al. (2023)
Med-PaLM 22023PaLM-2 + RLHF540B-classMedical QA, benchmark-level reasoningMedQA, MedMCQA, PubMedQA, MMLU-clinicalMedQA 86.5%Closed; English-centric; under-tested on rare/global diseasesSinghal et al. (2023)
MEDITRON-70B2023LLaMA-2 + medical CPT7B/70BOpen medical reasoning, USMLE-style QAMedQA, MedMCQA, PubMedQA, MMLU-clinicalMedQA ≈ 70% (70B); near Med-PaLM 2Open but compute-heavy; uneven on safety evaluationsChen et al. (2023)
MedAlpaca2023LLaMA + medical instr. tuning7B/13BConversational medical QAMedQA, USMLE-style dataImproved over base LLaMA on MedQA (reported)Limited safety auditing; not for clinical deploymentHan et al. (2023)
Med-Gemini2024Gemini multi-modal- (Gemini family)Multi-modal clinical QA, imaging, genomicsMedQA, MedMCQA, PubMedQA, image + textMedQA 91.1% (best variant reported)Closed-source; limited external safety auditing; costSaab et al. (2024)
GPT-4 (medical)2023GPT-4 (general)n.r.USMLE-style QA, differential diagnosisMedQA, NEJM casesMedQA 86.1%; passes USMLE without tuningNot medically certified; hallucinations on rare diseasesOpenAI, 2023; Nori et al. (2023)
Almanac (RAG)2024GPT-4 + retrieval-Clinical decision support with citationsCurated clinical-guideline corpusHigher factual accuracy + citation rate vs. base GPT-4Bounded by retrieval corpus; not deployed at scaleZakka et al. (2024)
MedRAG2024Multiple LLMs + retrievalvariesRAG evaluation for medical QAMIRAGE (MedQA, MedMCQA, PubMedQA, BioASQ, MMLU-Med)Quantifies RAG gains across LLM backbonesEvaluation-suite-specific; English-only corporaXiong et al. (2024)
ChatGPT (clinical)2023GPT-3.5/4 (general)n.r.Diagnostic reasoning, patient-facing repliesUSMLE practice items, NEJM-style casesUSMLE near-passing without fine-tuneHallucinations; not certified for clinical careKung et al. (2023), Patel and Lam (2023)
scGen2019VAE + perturbation latent shift∼1MSingle-cell perturbation response predictionPBMC, single-cell atlasesR 2 improvements over baselines on held-out perturbationsLinear latent shifts; limited compositional generalisationLotfollahi et al. (2019)
Geneformer2023BERT-style on rank-value gene tokens∼10MGene-network reasoning, patient stratification, perturbationGenecorpus-30M (∼30M single cells)Improves over baselines on cardiomyocyte/disease-cell tasksBulk-derived gene ranks; reliance on reference distributionsTheodoris et al. (2023)
scGPT2024GPT-style decoder for single-cell53MCell-type annotation, perturbation prediction, integrationCELLxGENE, Tabula SapiensCell-type accuracy >90% on reference atlasesDrops on rare cell types and OOD; English-language metadataCui et al. (2024)
DNABERT2021BERT encoder, k-mer tokens110MPromoter, splice-site, regulatory predictionHuman genome (GRCh38)SOTA at release on multiple regulatory tasksLimited cross-species transfer; sequence length capJi et al. (2021)
DNABERT-22023BERT encoder, BPE tokens117MVariant-effect/regulatory predictionGUE multi-species benchmarkSOTA on GUE across most tasks at releaseAncestry bias; limited rare-variant coverageZhou et al. (2023)
Nucleotide Transformer2023BERT-style on long DNA50M–2.5BVariant effect, regulatory annotation3,202 human genomes +850 speciesSOTA on 18 genomic prediction tasks (reported)Compute-heavy; limited explainabilityDalla-Torre et al. (2023)
HyenaDNA2024Hyena long-context0.4M–6.6MSingle-nucleotide-resolution long-range genomicsHuman reference; GenomicBenchmarksUp to 1M-bp context; SOTA at releaseNew architecture; reproducibility infrastructure maturingNguyen et al. (2024)
ESM-2/ESMFold2023Protein LM (encoder)8M–15BVariant effect, structure predictionUniRef, CASP14/15ESMFold pLDDT ≈ 0.87 on representative targetsLimited on disordered regions; not validated for rare variantsLin et al. (2023), Rives et al. (2021)
GeneGPT2023Codex/GPT-3.5-turbo + NCBI tools- (Codex/GPT-3.5)Genomic QA over NCBI resourcesGeneTuring benchmarkOutperforms ChatGPT on GeneTuring (reported)API-dependent; closed model; costJin et al. (2023)
Criteria2Query2021BERT-style NLP + rulesn.r.Clinical-trial eligibility query constructionClinicalTrials.govPrecision/recall reported per criterion; reduces manual workBrittle on complex/nested inclusion logicYuan et al. (2019)
Trial2Vec2022Transformer trial embeddingn.r.Trial-patient matchingClinicalTrials.govAUROC ≈ 0.80 on matching taskLimited on rare diseases; English-only trial textWang and Sun (2022)
BiomedGPT2024Multi-modal transformer- (mid-scale)Multi-task biomedical: imaging, text, QA15 biomedical datasets, MIMIC-CXRSOTA on multiple biomedical multi-modal benchmarks (reported)Limited safety auditing; closed-clinical deployment dataZhang et al. (2024)
PaccMann2021Multi-modal (omics + SMILES)∼10MDrug-response/precision-oncology predictionGDSC, CCLE, TCGAR 2 ≈ 0.85 on held-out cell-line response (reported)Cell-line bias; cohort transfer challengesBorn et al. (2021), Born and Manica (2023)

Columns capture model name, release year, base architecture, parameter count (“n.r.” indicates not reported), clinical task, evaluation dataset/cohort, reported metric where stated, and key limitations or clinical risks. Reported metrics are taken from the original publications; benchmark coverage cross-checked against Song et al. (2025) and the healthcare-LLM benchmarking review by Budler et al. (2025). This list is non-exhaustive.

5.1 Pretraining and fine-tuning strategies

Pretraining on large-scale corpora provides LLMs with foundational knowledge that can be transferred to downstream tasks through fine-tuning or prompting (Devlin et al., 2019; Brown et al., 2020; Lee et al., 2020). The choice of pretraining data, objective, and scale significantly impacts model capabilities and suitability for biomedical applications. For biomedical LLMs, pretraining typically combines general-purpose text corpora with domain-specific sources including scientific literature from PubMed and PubMed Central, clinical documentation from electronic health record systems, molecular databases such as ChEMBL, DrugBank, and UniProt, and structured knowledge resources including ontologies and knowledge graphs (Lee et al., 2020; Gu et al., 2021; Wishart et al., 2018; Mendez et al., 2019). Pretraining objectives vary based on the intended application and model architecture. Masked language modeling (MLM), used in BERT-style encoder models, trains the model to predict randomly masked tokens from bidirectional context, producing representations suited for classification and extraction tasks (Devlin et al., 2019; Lee et al., 2020). Autoregressive language modeling, used in GPT-style decoder models, trains prediction of the next token given previous tokens, naturally supporting generation tasks (Radford et al., 2019; Luo et al., 2022). Sequence-to-sequence objectives, used in encoder-decoder architectures like T5 and BART, train mapping from input sequences to output sequences, supporting translation and transformation tasks (Edwards et al., 2022a). Domain-specific pretraining objectives have been developed for molecular and biological sequences, including span prediction for proteins and contrastive learning across modalities (Ross et al., 2022; Rives et al., 2021).

Fine-tuning adapts pretrained models to specific downstream tasks using labeled training data. Standard fine-tuning updates all model parameters on the downstream task, which can achieve high performance but requires substantial computational resources and risks catastrophic forgetting of pretrained knowledge. Parameter-efficient fine-tuning methods, including Low-Rank Adaptation (LoRA) and adapter modules, update only a small fraction of parameters while keeping pretrained weights frozen, reducing computational requirements and maintaining more of the pretrained knowledge (Touvron et al., 2023b). Instruction tuning trains models to follow natural language task descriptions, improving generalization to novel tasks specified at inference time (the scaling and openness of these instruction-tuned models in our corpus are visualised in Figures 4, 7) (Wei et al., 2022; Fang et al., 2023). Reinforcement learning from human feedback (RLHF) further refines model outputs by training on human preference judgments, improving alignment with human intentions and values.

Table 3 provides a comprehensive overview of key biomedical language models across different application domains, including their architecture, training data, and primary applications.

TABLE 3. Overview of key large language models for biomedical applications. Parameter counts and training data verified from original publications (Lee et al., 2020; Luo et al., 2022; Singhal et al., 2023; Gu et al., 2021; Alsentzer et al., 2019; Lin et al., 2023; Zhou et al., 2023; Cui et al., 2024; Ahmad et al., 2022).

ModelParamsArchitectureTraining dataPrimary applications
BioBERT110MEncoderPubMed abstractsNER, relation extraction
PubMedBERT110MEncoderPubMed (from scratch)Biomedical NLP benchmarks
ClinicalBERT110MEncoderMIMIC-III notesClinical text mining
BioGPT347MDecoderPubMedText generation, QA
Med-PaLM 2540BDecoderMedical literature + RLHFClinical reasoning, exams
ESM-215BEncoderUniRef protein sequencesStructure prediction
ChemBERTa-246MEncoderZINC, PubChem SMILESProperty prediction
DNABERT-2117MEncoderMulti-species genomesVariant effect prediction
scGPT53MDecoderSingle-cell atlasesCell annotation, perturbation

To complement the architectural overview above, Table 1 summarises representative LLM-based frameworks for drug discovery alongside their reported performance metrics, evaluation datasets, and documented limitations, and Table 2 provides the analogous comparison for precision-medicine applications. These tables synthesise data drawn from the source publications cited in Sections 3, 4, together with the recent overview by Song et al. (2025), and are intended to facilitate side-by-side comparison of strengths, weaknesses, and trade-offs rather than to repeat the descriptive narrative.

5.2 Transformer architectures for biomedical data

The transformer architecture provides the foundation for essentially all modern large language models, with variants adapted for different data types and application requirements (Vaswani et al., 2017; Hays, 2026a). The core self-attention mechanism enables each position in a sequence to attend to all other positions, capturing long-range dependencies without the sequential processing constraints of recurrent architectures. Multi-head attention allows the model to jointly attend to information from different representation subspaces, capturing diverse relationship types. Position encodings, whether learned or sinusoidal, provide sequence order information that the permutation-invariant attention mechanism would otherwise lack.

For molecular data, transformer architectures process SMILES strings as character or subword sequences, with tokenization strategies that can influence model performance (Chithrananda et al., 2020; Bagal et al., 2022). SMILES-level tokenization treats individual characters as tokens, while subword tokenization methods like byte-pair encoding (BPE) can learn meaningful chemical substructure tokens from data. Graph transformers extend the architecture to process molecular graphs directly, using attention mechanisms that respect graph structure by restricting attention to connected nodes or incorporating edge features into attention computation (Xiong et al., 2020). Hybrid approaches combine sequence-based transformers with graph neural networks to capture complementary aspects of molecular structure.

For protein sequences, protein language models apply standard transformer architectures to amino acid sequences, with position encodings that can extend to the longer sequence lengths typical of proteins compared to natural language sentences (Lin et al., 2023; Rives et al., 2021). ESM-2 demonstrated that scaling protein language models to 15 billion parameters substantially improves learned representations, with the largest models approaching AlphaFold2-level structure prediction accuracy (Lin et al., 2023). ProtGPT2 applied autoregressive language modeling to protein generation, producing novel sequences that fold into stable structures (Ferruz et al., 2022). Specialized architectures for proteins have explored incorporating evolutionary information through multiple sequence alignments or structure-aware positional encodings.

For genomic sequences, DNA language models adapt transformer architectures to nucleotide sequences with appropriate tokenization and positional encoding strategies (Zhou et al., 2023; Ji et al., 2021). DNABERT uses k-mer tokenization to create tokens representing short nucleotide subsequences, reducing sequence length while capturing local context (Ji et al., 2021). Long-context architectures are particularly important for genomics, where regulatory relationships can span kilobases or megabases. HyenaDNA achieves single-nucleotide resolution over sequences up to 1 million bases through efficient attention approximations (Nguyen et al., 2024).

5.3 Multi-modal architectures

Multi-modal architectures integrate information from different data types within unified model frameworks, enabling reasoning across modalities that is essential for drug discovery and precision medicine applications (Cao et al., 2023; Liu S. et al., 2023; Taylor et al., 2022). Design choices for multi-modal systems include the selection of modality-specific encoders, alignment mechanisms to create shared representations, and fusion strategies to combine information for downstream tasks. Modality-specific encoders process each data type using architectures suited to its structure. For molecules, encoders may be graph neural networks, transformers processing SMILES strings, or 3D convolutional networks processing molecular geometry. For proteins, transformers processing amino acid sequences leverage pretrained protein language model representations. For text, standard transformer language models provide encodings. For images, vision transformers or convolutional networks extract features. The choice of encoder architecture affects what information is captured and how effectively it transfers to downstream tasks.

Alignment mechanisms create shared representation spaces where entities from different modalities can be compared and combined. Contrastive learning aligns representations by training the model to produce similar embeddings for matched pairs (such as molecules and their text descriptions) while producing dissimilar embeddings for mismatched pairs (Liu S. et al., 2023). This approach learns an embedding space where semantically related entities cluster together regardless of modality, enabling cross-modal retrieval and comparison. Cross-attention mechanisms provide another alignment approach, where queries from one modality attend to keys and values from another, allowing flexible information exchange between modalities. Fusion strategies combine aligned representations for downstream prediction or generation. Early fusion concatenates or combines modality-specific representations before processing through shared layers. Late fusion processes each modality independently through most of the model, combining only at the final prediction stage. Cross-modal attention enables dynamic fusion where the degree of information exchange is learned based on the task. The optimal fusion strategy depends on the specific task and the nature of relationships between modalities. InstructMol exemplifies multi-modal integration for molecular understanding, combining a molecular encoder with a language model through instruction tuning (Cao et al., 2023). The two-stage training approach first pretrains encoders separately, then fine-tunes the combined system on instruction-following tasks that require cross-modal reasoning. This approach enables the model to answer questions about molecules, generate molecules from text descriptions, and perform other tasks requiring integration of molecular and language understanding.

5.4 Graph neural networks and molecular representations

Graph neural networks (GNNs) process molecular structures as graphs where atoms are nodes and bonds are edges, learning representations that capture topological and chemical properties (Nguyen et al., 2021; Xiong et al., 2020; Hays, 2026b). Unlike sequence-based representations that require imposing an artificial ordering on atoms, graph representations naturally preserve molecular symmetry and can incorporate rich atomic and bond features. GNN architectures differ in their message-passing schemes that aggregate information from neighboring nodes and their readout functions that produce graph-level representations from node embeddings. Message passing neural networks (MPNNs) provide a general framework encompassing many GNN variants, where node representations are iteratively updated by aggregating messages from neighboring nodes (Yang et al., 2019; Xiong et al., 2020). The Attentive FP architecture applies graph attention to molecular property prediction, using attention weights to differentially weight contributions from neighboring atoms based on their relevance (Xiong et al., 2020). Graph convolutional networks aggregate neighbor information through convolution-like operations, while graph transformers extend self-attention to graph-structured data.

The integration of GNNs with language models enables molecular understanding that leverages both structural and semantic information. Graph-enhanced language models incorporate GNN-derived representations into transformer architectures through cross-attention or concatenation. Conversely, language model representations can provide semantic features that augment graph-based molecular representations, for example, by encoding textual descriptions of molecular properties or mechanism of action. Three-dimensional molecular representations capture spatial geometry that sequence-based and two-dimensional graph representations cannot encode (Corso et al., 2023; Hoogeboom et al., 2022; Xu et al., 2022). Equivariant neural networks process 3D molecular structures while respecting their rotational and translational symmetry, ensuring that predictions are independent of the arbitrary orientation of input molecules. These architectures are particularly important for structure-based drug design, where the geometry of protein-ligand interactions determines binding affinity and specificity.

5.5 Diffusion models for molecular generation

Diffusion models have emerged as a powerful paradigm for generative modeling, achieving state-of-the-art results in image generation and increasingly being applied to molecular generation and structure prediction (Corso et al., 2023; Hoogeboom et al., 2022; Xu et al., 2022; Schneuing et al., 2022). The diffusion framework learns to reverse a gradual noising process, training a neural network to predict the noise added at each step so that sampling can proceed by iteratively denoising from random noise to generate realistic samples.

For molecular generation, diffusion models can operate on various molecular representations including atom coordinates in 3D space, molecular graphs, or sequences (Hoogeboom et al., 2022; Xu et al., 2022). Equivariant diffusion models generate 3D molecular structures while respecting rotational and translational invariance, producing molecules whose properties are independent of coordinate frame choice (Hoogeboom et al., 2022). GeoDiff applied diffusion to molecular conformation generation, predicting the 3D geometry of molecules from their 2D graphs (Xu et al., 2022). These approaches can generate molecular structures that satisfy complex geometric constraints relevant to drug binding. Structure-based diffusion models generate molecules that bind to specific protein targets by conditioning the diffusion process on target structure (Corso et al., 2023; Schneuing et al., 2022). DiffDock applied diffusion to molecular docking, directly generating binding poses rather than scoring enumerated poses, achieving state-of-the-art docking performance (Corso et al., 2023). Pocket-conditioned generation enables design of molecules complementary to target binding sites, integrating target structure information into the generation process.

5.6 Retrieval-augmented generation

Retrieval-augmented generation (RAG) enhances language model capabilities by retrieving relevant information from external knowledge sources at inference time, combining the flexibility of neural generation with the reliability of curated knowledge bases (Lewis et al., 2020; Zakka et al., 2024; Xiong et al., 2024). Rather than relying solely on knowledge encoded in model parameters during pretraining, RAG systems query external databases or document collections to find relevant information that is then included in the model’s context for generating responses. RAG architectures typically consist of a retriever that identifies relevant documents or passages and a generator that produces outputs conditioned on retrieved context. Dense passage retrieval uses neural embeddings to find semantically relevant passages, while sparse retrieval based on term matching can efficiently search large collections. The generator may be a standard language model with retrieved passages prepended to the input, or specialized architectures that explicitly model the relationship between query, retrieved documents, and output.

For biomedical applications, RAG offers several advantages over purely parametric models. It enables access to current information beyond the model’s training cutoff, which is particularly important given the rapid pace of biomedical research. It reduces hallucination by grounding outputs in retrieved evidence, addressing a major concern for clinical applications. It provides transparency through citation of sources, enabling verification of model outputs. And it can be updated by changing the retrieval corpus without retraining the model, facilitating rapid incorporation of new findings.

5.7 Evaluation frameworks and benchmarks

Rigorous evaluation is essential for assessing LLM performance and identifying areas for improvement. Evaluation frameworks for biomedical LLMs encompass diverse tasks and metrics reflecting the range of applications in drug discovery and precision medicine (Singhal et al., 2023; Wu et al., 2018; Polykovskiy et al., 2020). For molecular property prediction, MoleculeNet provides standardized benchmarks covering physical chemistry, biophysics, physiology, and toxicology, with metrics including AUROC, RMSE, and MAE depending on the specific task (Wu et al., 2018). For molecular generation, MOSES benchmarks evaluate validity, uniqueness, novelty, and distribution learning metrics (Polykovskiy et al., 2020). For drug-target interaction prediction, benchmarks on DAVIS, KIBA, and BindingDB datasets evaluate prediction accuracy with particular attention to cold-split scenarios that test generalization to novel compounds or targets.

For clinical applications, medical question answering benchmarks including MedQA, PubMedQA, and MedMCQA evaluate knowledge and reasoning capabilities (Singhal et al., 2023; Kung et al., 2023). Beyond accuracy, evaluation of clinical systems must consider factors including explanation quality, potential for harm, and alignment with clinical consensus. Human evaluation remains essential for assessing whether model outputs would be useful and safe in real clinical contexts.

6 Current applications and case studies

The theoretical potential of LLMs in drug discovery and precision medicine is being realized through diverse real-world applications that demonstrate practical impact across the drug development pipeline and clinical practice. This section examines specific case studies and applications that illustrate how these technologies are being deployed to address concrete biomedical challenges, providing evidence of both the current capabilities and the remaining gaps between research advances and clinical utility.

6.1 End-to-end drug discovery pipelines

The vision of fully integrated, AI-driven drug discovery pipelines is beginning to be realized through systems that combine multiple LLM capabilities within unified computational frameworks. These end-to-end approaches aim to automate or accelerate the entire discovery process, from initial target identification through lead optimization and preclinical characterization. ChemCrow demonstrated an integrated approach to chemical research by augmenting a large language model with access to specialized chemistry tools (Bran et al., 2024). When presented with drug discovery objectives, the system can autonomously decompose complex tasks into subtasks, invoke appropriate computational tools for property prediction and reaction planning, search the literature for relevant precedents, and synthesize results into actionable recommendations. In the original report, ChemCrow demonstrated promising performance on multi-step synthesis planning benchmarks and property optimization objectives, illustrating the potential for LLM-orchestrated drug discovery workflows; independent evaluations, however, have been mixed, with subsequent studies highlighting sensitivity to tool choice, prompting strategy, and benchmark construction and cautioning against extrapolating from curated demonstrations to routine medicinal-chemistry practice.

Autonomous chemical research systems have extended this paradigm to include robotic experimentation, creating closed-loop systems that integrate computational design with physical synthesis and characterization (Boiko et al., 2023). These systems use LLMs to interpret experimental results, propose next experiments based on observed outcomes, generate detailed experimental protocols, and coordinate robotic platforms to execute synthesis and testing. While still primarily demonstrated in academic settings, such systems point toward a future where drug discovery proceeds through continuous automated cycles of design, synthesis, testing, and optimization. The development of potent DDR1 kinase inhibitors by Insilico Medicine represents one of the most publicized examples of AI-accelerated drug discovery (Zhavoronkov et al., 2019). This landmark study employed generative tensorial reinforcement learning (GENTRL) to design novel DDR1 kinase inhibitors, completing the entire cycle from target selection to synthesis of lead candidates in just 21 days. The generated molecules demonstrated nanomolar potency against DDR1 and exhibited favorable pharmacokinetic properties in mouse studies, providing compelling proof-of-concept that AI-driven molecular generation can produce experimentally validated drug candidates with activity comparable to traditionally discovered compounds. While this work predates the current generation of LLMs, it established the potential for AI-driven molecular generation to produce experimentally validated drug candidates. Building on this foundation, Insilico Medicine subsequently advanced INS018_055, a first-in-class inhibitor of TNIK (TRAF2 and NCK-interacting kinase) for idiopathic pulmonary fibrosis, through Phase II clinical trials, representing one of the first AI-designed drugs to reach this stage (Xu et al., 2025). The drug advanced from initiation of target discovery to completion of phase 0/1 clinical testing in under 30 months, substantially faster than traditional timelines. Another landmark achievement was the discovery of halicin, a structurally novel antibiotic identified through deep learning screening of the Drug Repurposing Hub, which demonstrated broad-spectrum activity against pan-resistant Acinetobacter baumannii infections in mouse models (Stokes et al., 2020). The halicin discovery exemplified how AI could identify compounds with mechanisms of action distinct from existing antibiotics, addressing the critical challenge of antimicrobial resistance. More recently, Recursion Pharmaceuticals has applied transformer-based models to identify novel treatments for rare diseases, including cerebral cavernous malformation and neurofibromatosis type 2, leveraging phenotypic screening data integrated with multi-modal embeddings (Stokes et al., 2020; Chon et al., 2017).

It is important to put these case studies in proper perspective with respect to clinical-trial integration. As of late 2025, the number of AI-designed small molecules that have actually entered human studies remains small (on the order of 20–30 publicly disclosed Phase I or Phase I/II candidates across companies such as Insilico Medicine, Exscientia, Recursion, BenevolentAI, and Schrödinger), and none has yet received marketing authorisation. Reported Phase I success rates of ∼80%–90% for the first wave of AI-discovered candidates (Jayatunga et al., 2024) (compared to historical industry averages of ∼50%–60%) are based on small cohorts and short follow-up, so they should be treated as encouraging but preliminary signals rather than as established attrition reductions. The strongest evidence to date that AI-based discovery can compress timelines is completion of phase 0/1 clinical testing in under 30 months from the initiation of target discovery reported for INS018_055 (versus ∼4–6 years traditionally) (Xu et al., 2025) and the rapid antibiotic discovery exemplified by halicin (Stokes et al., 2020); whether these accelerations translate into improved Phase II/III success and approved therapies will only become clear over the next 3–5 years. Throughout this review we therefore distinguish carefully between (a) benchmark performance, (b) wet-lab or preclinical validation, and (c) prospective clinical evidence, and we recommend the same distinction when interpreting individual claims.

6.2 Precision oncology applications

Cancer treatment exemplifies the promise and complexity of precision medicine, as tumors exhibit substantial molecular heterogeneity that requires personalized therapeutic strategies. LLM applications in precision oncology span molecular tumor characterization, treatment recommendation, and clinical trial matching. The integration of large language models with molecular tumor boards represents an emerging application that could enhance clinical decision making for cancer patients. By synthesizing information from tumor genomic profiles, scientific literature, clinical guidelines, and trial databases, LLMs can identify relevant biomarkers, suggest targeted therapies, and match patients to appropriate clinical trials. Studies have demonstrated that LLM-based systems can identify treatment options with high concordance with expert tumor board recommendations while potentially identifying additional options not considered by human experts (Singhal et al., 2023).

Single-cell analysis powered by foundation models enables unprecedented resolution in understanding tumor heterogeneity and treatment resistance. scGPT and related models can analyze single-cell transcriptomes to identify resistant subpopulations, predict responses to perturbations, and suggest combination therapies targeting multiple cell states (Cui et al., 2024). For triple-negative breast cancer, which lacks targetable hormone receptors, transformer models analyzing tumor transcriptomes have identified patient subgroups with differential responses to immune checkpoint inhibitors, enabling more precise patient stratification for immunotherapy (Jiang et al., 2018). Drug synergy prediction for cancer combination therapy addresses the challenge of identifying drug pairs that work better together than individually (Preuer et al., 2018; Menden et al., 2019). DeepSynergy, a pioneering deep neural network developed by Preuer and colleagues, demonstrated the power of integrating chemical structure features with genomic information from cancer cell lines to predict synergistic drug combinations (Preuer et al., 2018). The model substantially outperformed other machine learning methods on benchmark datasets, establishing deep learning as a promising approach for combination therapy discovery. The subsequent DREAM Challenge on cancer drug combinations further validated these approaches and established benchmarks that continue to drive methodological advances in this area.

6.3 Clinical decision support implementations

Clinical decision support systems incorporating LLMs are being piloted in various healthcare settings, with applications spanning diagnostic support, treatment recommendation, and documentation assistance. Med-PaLM and related medical language models have demonstrated high-level performance on clinical reasoning benchmarks, achieving accuracy on medical licensing examinations comparable to or exceeding that of practicing physicians (Singhal et al., 2023; Nori et al., 2023). While performance on standardized exams does not guarantee clinical utility, these results establish a baseline of medical knowledge and reasoning capability that supports more applied clinical applications.

Discharge summary generation represents an early practical application of LLMs in clinical workflows. Generating comprehensive discharge summaries is time-consuming for clinicians but important for continuity of care. Studies have demonstrated that LLMs can generate high-quality draft summaries from clinical notes, potentially reducing documentation burden while maintaining or improving summary quality (Patel and Lam, 2023). Human oversight remains essential to verify accuracy and appropriateness for specific patients. Diagnostic decision support systems use LLMs to synthesize patient information and suggest differential diagnoses or next diagnostic steps. By processing clinical notes, laboratory values, and imaging reports, these systems can identify patterns consistent with specific diagnoses and flag findings requiring urgent attention. Integration with electronic health record systems enables deployment within existing clinical workflows, though careful attention to alert fatigue and workflow integration is essential for adoption.

6.4 Drug repurposing case studies

Drug repurposing accelerated by AI methods has demonstrated real-world impact, particularly during the COVID-19 pandemic when rapid identification of treatment options was critical (Zhou et al., 2020; Zeng et al., 2020; Gysi et al., 2021). While specific LLM-driven repurposing successes are still emerging, the methodological foundations established by these efforts support ongoing applications. Network medicine approaches combining knowledge graphs with machine learning identified candidate COVID-19 therapeutics by analyzing the proximity of drug targets to disease-associated genes in the interactome (Gysi et al., 2021). Several computationally identified candidates subsequently entered clinical trials, demonstrating the translational potential of AI-driven repurposing. Language models enhance these approaches by extracting relationships from literature to populate knowledge graphs and by synthesizing evidence to prioritize candidates.

Systematic mining of electronic health records for drug repurposing opportunities continues to yield candidates for clinical investigation. By analyzing patterns of drug exposure and disease outcomes across large patient populations, researchers can identify unexpected therapeutic effects that warrant prospective validation. LLMs enable more comprehensive analysis of these data by processing unstructured clinical notes to capture therapeutic effects not coded in structured fields. A compelling example is the repurposing of metformin, the widely prescribed diabetes medication, for cancer prevention and treatment. Analysis of large-scale electronic health records combined with mechanistic modeling revealed reduced cancer incidence in diabetic patients taking metformin, leading to numerous clinical trials investigating its anticancer properties across tumor types including breast, colorectal, and prostate cancers (Zaidi et al., 2019; Yu and Suissa, 2023). In neurodegenerative diseases, LLM-based analysis of clinical records has identified potential benefits of beta-2 adrenergic agonists for Parkinson’s disease risk reduction, with retrospective cohort studies supporting a protective association (Mittal et al., 2017).

6.5 Literature synthesis and knowledge extraction

The ability of LLMs to process and synthesize vast scientific literature represents a capability with broad applications across drug discovery and precision medicine. With biomedical publication rates exceeding 1 million articles annually, no human researcher can comprehensively survey even their specific field. Automated literature review using LLMs can rapidly synthesize evidence on specific topics, identify consensus and controversies in the field, and highlight knowledge gaps requiring further investigation. While current systems cannot fully replace expert literature review, they can substantially accelerate initial surveys and ensure comprehensive coverage of relevant publications.

Knowledge graph population using information extraction from text enables creation of structured knowledge resources from unstructured literature. Named entity recognition identifies mentions of drugs, diseases, genes, and other biomedical entities, while relation extraction identifies the relationships between them. LLMs have demonstrated improved performance on these extraction tasks, enabling more complete and accurate knowledge graphs that support downstream reasoning and prediction. Hypothesis generation from literature synthesis represents an intriguing emerging application. By identifying patterns across large bodies of literature, LLMs may suggest novel hypotheses that connect findings from disparate research areas. While validation of such hypotheses requires experimental investigation, computational hypothesis generation could accelerate scientific discovery by directing research attention to promising directions.

6.6 Comparative performance analysis

Table 4 summarizes the performance of selected LLM applications across different biomedical tasks, illustrating the current state of the art and areas of particular strength or remaining challenge.

TABLE 4. Performance comparison of large language model applications in drug discovery and precision medicine.

ApplicationTaskPerformanceKey findings
Med-PaLM 2Medical QA (MedQA)86.5% accuracyStrong scores on licensing exams
ESMFoldProtein structurepLDDT > 0.7 (29%)Single-sequence prediction
ChemBERTaProperty predictionAUROC 0.75–0.85Improves with scale
DiffDockMolecular dockingTop-1 success 38.2%Outperforms GLIDE (21.8%)
scGPTCell type annotationAccuracy > 90%Transfers across datasets
MolGPTMolecular generationValidity 98%Controllable generation

Performance metrics verified from original publications: Med-PaLM, 2 (Singhal et al., 2023), ESMFold (Lin et al., 2023), ChemBERTa-2 (Ahmad et al., 2022), DiffDock (Corso et al., 2023), scGPT (Cui et al., 2024), MolGPT (Bagal et al., 2022).

These results demonstrate that LLMs can achieve strong performance across diverse biomedical tasks (see Figure 8 for the corpus-wide view of reported metrics), often matching or exceeding specialized methods while offering greater flexibility and generalization. However, performance varies substantially across specific subtasks and evaluation conditions, and real-world utility depends on factors beyond benchmark performance including robustness, interpretability, and integration with existing workflows.

7 Challenges and limitations

Despite remarkable progress, the application of LLMs in drug discovery and precision medicine faces significant challenges that must be addressed to realize their full potential for improving human health. These challenges span technical, regulatory, ethical, and practical dimensions that together determine whether research advances will translate into clinical and commercial impact. Importantly, these challenges manifest differently across application domains, with distinct priorities emerging for drug discovery, clinical decision support, genomics and variant analysis, and clinical trial design. This section examines key limitations and obstacles, providing a balanced assessment of the current state and identifying priorities for future development.

7.1 Domain-specific challenge profiles

The relative importance of implementation challenges varies substantially across biomedical AI application domains, reflecting fundamental differences in data characteristics, regulatory environments, and end-user requirements (Gerke et al., 2020; Char et al., 2018). Understanding these domain-specific profiles is essential for prioritizing research investments and deployment strategies.

Drug discovery presents a unique challenge landscape where interpretability and generalization emerge as primary concerns. Interpretability is critical because understanding why a model predicts a molecule will be active against a target is essential for guiding medicinal chemistry optimization and generating testable mechanistic hypotheses (Jiménez-Luna et al., 2020; Preuer et al., 2019). Without mechanistic insight, researchers cannot rationally improve predicted candidates or identify potential liabilities. Generalization poses particular difficulties because drug discovery inherently requires predictions for novel chemical entities and previously unexplored targets; cold-start performance on entities absent from training data directly determines practical utility (Huang et al., 2021; Yazdani-Jahromi et al., 2022). Hallucination risk is moderate but consequential, as fabricated mechanisms of action or pharmacokinetic properties could misdirect expensive experimental programs. Data quality concerns center on inconsistencies across assay conditions in public databases rather than demographic bias, while privacy considerations are less acute given that molecular data typically lacks direct patient identifiers.

Clinical decision support faces the broadest array of critical challenges due to direct patient safety implications. Hallucination risk is paramount because fabricated symptoms, drug interactions, or treatment recommendations could cause immediate patient harm (Thirunavukarasu et al., 2023; Lee et al., 2023). Interpretability is equally critical, as clinicians must understand the reasoning behind AI recommendations to appropriately trust and act upon them, and regulatory agencies require explanations for AI-driven decisions in patient care (Gerke et al., 2020). Privacy and security concerns are severe given the sensitivity of protected health information under HIPAA, GDPR, and similar regulations, with additional risks that language models may memorize and reveal patient data (Rieke et al., 2020; Dayan et al., 2021).

Regulatory compliance requirements are stringent for medical devices, and workflow integration must address alert fatigue and clinician acceptance (Rajkomar et al., 2018; Shickel et al., 2018). Data quality challenges include demographic underrepresentation that can produce biased predictions across patient populations (Obermeyer et al., 2019).

Genomics and variant analysis applications face distinctive challenges centered on privacy, generalization, and interpretability. Privacy concerns are particularly acute because genetic data is inherently identifiable and has implications extending to family members, raising unique consent and re-identification risks. Generalization across populations represents a critical concern because genomic models trained predominantly on European ancestry populations may perform poorly for underrepresented groups, potentially exacerbating health disparities (Obermeyer et al., 2019). Interpretability matters for variant classification because clinicians and genetic counselors must explain pathogenicity assessments to patients in the context of clinical decision-making. Hallucination risk is moderate but concerning when models confidently misclassify variants of uncertain significance. Data quality issues arise from heterogeneous variant annotation standards across databases and the challenge of rare variant interpretation with limited population frequency data.

Clinical trial design requires careful attention to data quality, regulatory compliance, and workflow integration. Data quality concerns focus on selection bias in historical trial data that could propagate to eligibility criteria optimization or endpoint selection. Regulatory compliance is critical because clinical trials operate under stringent ICH guidelines, and AI-assisted design decisions must satisfy regulatory scrutiny across multiple jurisdictions. Workflow integration challenges arise from the need to coordinate AI tools across sponsors, clinical research organizations, and trial sites with heterogeneous information systems. Interpretability requirements ensure that sponsors can justify AI-driven design decisions to regulators and ethics committees. Privacy considerations involve protecting participant data while enabling multi-site collaboration, though formal data sharing agreements typically address these concerns. Generalization challenges emerge when applying models trained on historical trials to novel therapeutic areas or patient populations.

7.2 Data quality, availability, and bias

The performance of LLMs depends critically on the quality, quantity, and representativeness of training data, and biomedical domains face particular challenges in each of these dimensions (Vamathevan et al., 2019; Obermeyer et al., 2019). Data scarcity presents a fundamental obstacle for rare diseases, novel therapeutic targets, and emerging pathogens where limited historical data is available for model training. Even for common diseases, labeled datasets for specific prediction tasks may be small, expensive to curate, or of uncertain quality due to noise in experimental measurements or inconsistencies in clinical documentation. Data bias represents a critical concern with implications for both scientific validity and health equity (Obermeyer et al., 2019; Char et al., 2018).

Training datasets may underrepresent certain patient populations, disease subtypes, or molecular classes, leading to models that perform poorly for these underrepresented groups. Historical biases encoded in clinical data, such as differential access to care or documentation practices that vary across providers and institutions, can propagate through model training to produce biased predictions. Studies have demonstrated that algorithms used in healthcare can exhibit racial bias, recommending different levels of care for Black and white patients with similar health needs (Obermeyer et al., 2019). Addressing these biases requires careful attention to training data composition, evaluation across demographic subgroups, and ongoing monitoring of deployed systems.

Bias in biomedical training corpora is especially acute for genomic and clinical models. Genome-wide association studies and reference panels remain dominated by individuals of European ancestry, so genomic LLMs such as DNABERT-2 and the Nucleotide Transformer inherit ancestry-skewed variant frequency distributions and may produce miscalibrated pathogenicity scores for African, Hispanic, and South Asian populations. Clinical LLMs trained on MIMIC-III/IV inherit the demographics of a single urban ICU and the documentation conventions of one institution, which limits their generalisability to outpatient, paediatric, and non-U.S. settings. Similarly, molecular databases such as ChEMBL over-represent kinases and GPCRs relative to less tractable targets, biasing generative chemistry models toward chemotypes that have already been thoroughly explored. Mitigation strategies include explicit re-weighting of under-represented strata, federated training across institutions to broaden patient representation, and routine subgroup evaluation as part of model release. These mitigations are necessary but not sufficient: most current biomedical LLM releases do not report demographic or chemotype-stratified performance, making it difficult to audit residual bias from the published evidence alone.

Closely related to bias are concerns about reproducibility and generalisability. Many recent LLM-based drug-discovery studies report state-of-the-art results on a single benchmark using a single random seed, with limited information about training data overlap, hyperparameter search, or held-out cold-split protocols. Performance on temporally split test sets (i.e., training on pre-2023 data and testing on 2024 entries) tends to be substantially lower than on standard random splits, indicating that some published gains partly reflect dataset leakage rather than genuine generalisation. The community has begun to converge on more rigorous evaluation through benchmarks such as Therapeutics Data Commons (TDC) 2.0, ChemBench, MOSES, and GuacaMol, but reproducibility remains uneven: closed-source models such as GPT-4, Med-PaLM 2, and Tx-LLM cannot be independently audited, and even open-source releases often omit the exact training-data snapshots and prompts used to obtain the reported numbers. Reviewers and readers should therefore interpret single-metric headlines with caution and prefer multi-benchmark, multi-seed comparisons whenever available.

The quality of biomedical data is often uncertain and variable. Experimental measurements contain noise from technical variability and biological heterogeneity. Clinical documentation may be incomplete, inconsistent, or ambiguous. Drug activity annotations in public databases may reflect different assay conditions that are not comparable. Label noise in training data can degrade model performance and lead to unreliable predictions. Careful curation, data cleaning, and uncertainty quantification are essential for training reliable models, but comprehensive quality assessment remains challenging at the scale of data used for modern LLMs. Privacy constraints limit access to clinical data needed for training and validating precision medicine applications. Electronic health records contain sensitive patient information protected by regulations including HIPAA in the United States and GDPR in Europe. Sharing clinical data across institutions for model development raises privacy concerns even when data is de-identified, as language models may memorize and reveal sensitive training information. These constraints create tension between the need for large, diverse training datasets and the imperative to protect patient privacy.

7.3 Model interpretability and explainability

LLMs are often characterized as black boxes whose decision-making processes are opaque and difficult to understand (Jiménez-Luna et al., 2020; Preuer et al., 2019). In healthcare and drug discovery, where decisions have significant consequences for patient outcomes and resource allocation, interpretability is not merely desirable but essential for multiple stakeholders. Clinicians must understand why a model makes specific recommendations to trust and act on them appropriately. Regulatory agencies require explanations for AI-driven decisions in drug development and clinical care. Researchers need to understand model reasoning to generate biological hypotheses and design experiments. And patients deserve transparency about how AI systems influence their care. Current approaches to interpretability provide partial solutions but fall short of fully transparent reasoning. Attention visualization shows which input elements the model attends to, but attention weights do not necessarily indicate causal importance for predictions (Rodríguez-Pérez and Bajorath, 2020). Feature attribution methods like SHAP values quantify the contribution of input features to predictions, but may not capture the complex interactions learned by deep models. Chain-of-thought prompting can elicit natural language explanations of model reasoning, but these explanations may not faithfully reflect the model’s internal computations. The gap between model explanations and actual reasoning processes limits the utility of current interpretability methods for building justified trust in model outputs.

Knowledge-grounded approaches offer improved transparency by explicitly connecting model outputs to external knowledge sources (Lewis et al., 2020; Zakka et al., 2024). Retrieval-augmented systems can cite the sources used to generate responses, enabling verification of factual claims. Knowledge graph-enhanced models can trace reasoning through explicit relationship chains. These approaches provide more auditable decision processes than purely parametric models, though they introduce additional complexity and potential failure modes in the retrieval and reasoning components.

7.4 Hallucination and factual reliability

Hallucination, the generation of plausible-sounding but factually incorrect information, represents a fundamental limitation of current LLMs with particularly serious implications for biomedical applications (Thirunavukarasu et al., 2023; Lee et al., 2023). In drug discovery, hallucinated mechanisms of action or pharmacokinetic properties could lead to misguided research directions. In clinical care, fabricated symptoms, drug interactions, or treatment recommendations could cause patient harm. Even citation of nonexistent studies or misrepresentation of research findings undermines scientific integrity and clinical decision making. The frequency and characteristics of hallucination vary across model architectures, training approaches, and application domains. Studies have documented that even state-of-the-art medical LLMs produce factually incorrect responses at non-negligible rates, including on high-stakes clinical questions (Singhal et al., 2023; Nori et al., 2023). Hallucinations can be particularly difficult to detect because they are often fluent and superficially plausible, potentially fooling both automated evaluation systems and human reviewers unfamiliar with the specific topic.

Approaches to mitigate hallucination include retrieval-augmented generation that grounds outputs in retrieved evidence, knowledge graph constraints that limit responses to supported facts, and uncertainty quantification that flags low-confidence predictions (Zakka et al., 2024; Xiong et al., 2024). However, these approaches add complexity and do not completely eliminate hallucination risk. Overconfident predictions, where models express high certainty about incorrect statements, represent a particular challenge because they provide false assurance that can override appropriate skepticism. Given current limitations, human oversight remains essential for biomedical applications of LLMs. Critical outputs should be verified by domain experts before acting on them. Systems should be designed to augment rather than replace human judgment, providing information and suggestions that clinicians or researchers evaluate in context. Clear communication about model limitations and uncertainty is essential for appropriate use.

7.5 Privacy and security

Healthcare data is among the most sensitive personal information, and its use in training and deploying LLMs raises significant privacy and security concerns (Gerke et al., 2020; Rieke et al., 2020; Dayan et al., 2021). Language models trained on clinical text can memorize and potentially reveal sensitive patient information, even from de-identified data. Adversarial attacks could potentially extract training data from models or manipulate model outputs in harmful ways. Compliance with healthcare privacy regulations adds complexity to model development and deployment. Federated learning offers a promising approach to training models on distributed clinical data without centralizing sensitive information (Rieke et al., 2020; Dayan et al., 2021; Pati et al., 2022). In federated learning, model parameters rather than raw data are shared across institutions, with updates computed locally and aggregated centrally. This approach enables collaborative model development while keeping patient data within institutional boundaries. Successful demonstrations in COVID-19 outcome prediction and cancer imaging show the feasibility of federated approaches for healthcare AI (Dayan et al., 2021; Pati et al., 2022).

Differential privacy provides formal guarantees about information leakage by adding calibrated noise to model training or outputs. However, the privacy-utility tradeoff means that stronger privacy guarantees typically come at the cost of reduced model performance. Finding appropriate balance between privacy protection and model utility requires careful analysis of specific application requirements and risk tolerances.

7.6 Computational resources and accessibility

Training and deploying large language models requires substantial computational resources that may limit accessibility (Touvron et al., 2023a). Pretraining large models requires expensive GPU clusters that are available only to major technology companies, well-funded research institutions, and pharmaceutical companies. Even inference with large models may require specialized hardware, limiting deployment in resource-constrained settings. The environmental impact of training and running large models raises sustainability concerns. Efforts to democratize access to LLM capabilities include release of open-source model weights, development of efficient inference methods, and cloud-based APIs that amortize infrastructure costs across many users (Touvron et al., 2023a; Touvron et al., 2023b). Parameter-efficient fine-tuning methods reduce the computational cost of adapting pretrained models to specific tasks. Model compression techniques including quantization and distillation create smaller, faster models suitable for deployment on limited hardware. However, fundamental tradeoffs between model size, performance, and efficiency mean that the most capable models remain computationally expensive. Accessibility concerns extend beyond computational resources to include expertise required for effective use of LLM technologies. Prompt engineering, model selection, fine-tuning, and evaluation all require skills that may not be present in all research groups or clinical settings. Democratizing access requires not only making models available but also developing tools, documentation, and training that enable effective use by non-experts.

7.7 Generalization and domain shift

LLMs trained on specific datasets or domains may not generalize well to new contexts, a phenomenon known as distribution shift or domain shift (Yazdani-Jahromi et al., 2022). Models trained on one patient population may perform poorly on others with different demographic characteristics, disease prevalence, or clinical practices. Models trained on historical data may become outdated as medical knowledge and treatment practices evolve. Models trained for one therapeutic area may not transfer to others with different molecular mechanisms or patient presentations. Cold-split evaluation scenarios, which assess performance on entities entirely absent from training data, reveal generalization challenges that random splits may obscure (Huang et al., 2021; Yazdani-Jahromi et al., 2022). For drug-target interaction prediction, performance on novel drugs or novel targets typically falls substantially below performance on the full test set. For clinical prediction, performance on patients from new institutions or time periods may differ from performance on held-out patients from the original data. These generalization gaps are particularly concerning for applications where the goal is to make predictions about novel entities.

Continual learning and periodic retraining can help maintain model currency as new data becomes available, but raise questions about validation requirements and change management. Online learning approaches that update models continuously based on new observations must balance adaptation to changing conditions with stability and safety requirements. Determining when model updates require revalidation and regulatory review remains an open question with significant practical implications.

7.8 Ethical and regulatory considerations

The deployment of AI in healthcare raises profound ethical questions about autonomy, accountability, equity, and the appropriate role of technology in medical decision making (Gerke et al., 2020; Char et al., 2018). Patients have the right to understand when AI systems influence their care and to make informed decisions about accepting AI-derived recommendations. When AI systems contribute to clinical decisions, determining accountability for errors becomes complex. The potential for AI to exacerbate health disparities through biased predictions or unequal access to AI-enhanced care must be actively addressed.

Regulatory frameworks for AI in healthcare are evolving rapidly but remain incomplete (Gerke et al., 2020). Traditional regulatory paradigms designed for static medical devices may not adequately address continuously learning AI systems. Requirements for clinical validation must balance the need for evidence of safety and efficacy with the pace of technological development. International variation in regulatory requirements creates challenges for global deployment of AI-based tools. Addressing these ethical and regulatory challenges requires collaboration among diverse stakeholders including AI developers, healthcare providers, patients, ethicists, regulators, and policymakers. Principles for responsible AI development, including transparency, fairness, accountability, and privacy, must be operationalized in specific technical and organizational practices. Ongoing monitoring and evaluation of deployed systems is essential to identify and address problems that emerge in real-world use.

In practice, LLM-based drug-discovery and clinical-decision tools must navigate multiple, partially overlapping regulatory regimes. In the United States, software intended to inform clinical management can fall under the U.S. Food and Drug Administration’s (FDA) Software as a Medical Device (SaMD) framework, with additional guidance for Predetermined Change Control Plans for adaptive AI/ML models. In the European Union, equivalent tools are regulated under the Medical Device Regulation (MDR) and increasingly under the EU AI Act, which classifies most clinical AI systems as high-risk and imposes documentation, post-market surveillance, and human-oversight obligations. For drug-discovery applications, evidence generated by LLM-based tools that contributes to investigational new drug (IND) submissions or marketing authorisations must satisfy ICH guidelines (e.g., ICH E9, E14, M11) and is subject to scrutiny by the FDA Center for Drug Evaluation and Research and the European Medicines Agency (EMA). LLM-assisted patient stratification and trial-eligibility tools additionally interact with HIPAA, GDPR, and emerging national health-data regulations. These regimes generally require traceable training data provenance, lock-in of model versions used for regulatory submissions, documented evaluation across relevant subpopulations, and demonstration that human decision-makers retain meaningful oversight, all of which are challenging to provide for very large, closed-source foundation models.

Beyond regulatory compliance, the clinical risks of deploying LLMs in patient-facing settings warrant explicit consideration. Fluent but factually incorrect outputs (hallucinations) can produce confidently wrong diagnoses, drug-dose recommendations, or interaction warnings that propagate downstream into orders and prescriptions. Subtle distributional shifts (e.g., a new electronic health-record vendor, a new ICD coding standard, or a change in laboratory reference ranges) can silently degrade performance long after deployment. Automation bias, in which clinicians over-trust LLM-generated suggestions, may also lead to harm even when the underlying model is well-calibrated on average. Mitigations include systematically restricting LLM outputs to advisory rather than autonomous roles, embedding clear uncertainty signals, requiring explicit clinician confirmation for high-risk actions, performing prospective silent-mode evaluation before go-live, and instituting post-deployment monitoring with predefined alert thresholds for drift in calibration, demographic subgroup performance, and incident rates.

7.9 Integration with clinical workflows

Successful deployment of LLMs in clinical settings requires seamless integration with existing workflows, electronic health record systems, and clinical practices (Rajkomar et al., 2018; Shickel et al., 2018). Technical interoperability with healthcare IT infrastructure must be achieved, including compliance with data standards and security requirements. User interfaces must be intuitive for clinicians with varying levels of technical sophistication. AI recommendations must be presented at appropriate points in clinical workflows without causing alert fatigue or disrupting established practices. Human factors in AI adoption are at least as important as technical capabilities. Clinicians may distrust AI recommendations due to concerns about accuracy, accountability, or erosion of professional autonomy. Conversely, over-reliance on AI could lead to automation complacency where clinicians accept recommendations without appropriate scrutiny. Achieving appropriate calibration of trust requires transparent communication about AI capabilities and limitations, training in effective AI use, and ongoing feedback about AI performance.

Workflow disruption represents a significant barrier to adoption even for systems with demonstrated accuracy. Implementation of new technologies in healthcare settings is complex and often unsuccessful, with many clinical decision support systems failing to achieve widespread adoption despite evidence of effectiveness. Success requires careful attention to implementation science principles including stakeholder engagement, pilot testing, iterative refinement, and sustained organizational support.

8 Future directions

The rapid evolution of large language models in drug discovery and precision medicine suggests several promising directions for future research and development that could substantially expand the impact of these technologies. This section outlines key opportunities and emerging trends that are likely to shape the field in the coming years, while acknowledging the uncertainties inherent in forecasting technological progress.

8.1 Advanced foundation models for biomedicine

The development of increasingly capable foundation models specifically designed for biomedical applications represents a primary direction for advancing the field (Wang et al., 2023; Singhal et al., 2023). Current biomedical language models are substantially smaller than the largest general-purpose models, and scaling to larger sizes may yield significant performance improvements if appropriate training data and computational resources are available. The development of truly multi-modal foundation models that seamlessly integrate text, molecular structures, protein sequences, genomic data, medical images, and clinical records within unified architectures could enable more comprehensive biomedical reasoning than current single-modality or loosely coupled multi-modal systems. Specialized pretraining objectives and architectures tailored to the unique characteristics of biomedical data may yield further improvements beyond simple scaling. For molecular data, pretraining objectives that explicitly capture chemical constraints, stereochemistry, and reaction feasibility could improve generation quality. For protein sequences, incorporating evolutionary and structural information into the pretraining process could enhance representation learning. For clinical text, pretraining that captures the temporal structure of patient trajectories and the hierarchical organization of medical knowledge could improve clinical prediction tasks. The emergence of models capable of generating not only text but also experimental protocols, simulation code, and robotic commands points toward increasingly autonomous research systems (Boiko et al., 2023). Future foundation models may serve as central hubs coordinating complex research workflows that span computational prediction, experimental design, data analysis, and hypothesis generation. Realizing this vision will require advances in reliability, transparency, and safety that ensure appropriate human oversight of autonomous research processes.

8.2 Federated and privacy-preserving approaches

Privacy-preserving methods for training models on sensitive healthcare data represent a critical enabling capability for clinical applications (Rieke et al., 2020; Dayan et al., 2021; Pati et al., 2022). Federated learning approaches that train models across distributed clinical datasets without centralizing patient information are maturing from proof-of-concept demonstrations to production-ready systems. Future work will likely explore more sophisticated federated architectures including hierarchical federation across institutions, asynchronous updates that accommodate varying institutional participation, and personalized models that capture institution-specific patterns while sharing common structure. Differential privacy and other formal privacy frameworks may become standard components of biomedical LLM development, providing rigorous guarantees about information leakage that enable deployment in regulated healthcare environments. Advances in efficient privacy-preserving computation, including secure multi-party computation and homomorphic encryption, could enable new forms of privacy-preserving inference and training that are currently computationally prohibitive. Balancing privacy protection with model utility remains an active research area with substantial room for improvement.

The integration of privacy-preserving approaches with federated learning could enable collaborative model development across international boundaries, overcoming regulatory barriers that currently fragment healthcare AI development. Such collaboration could produce models trained on more diverse patient populations, addressing representativeness concerns that limit current models trained primarily on data from high-income countries.

8.3 Explainable and trustworthy artificial intelligence

The development of more interpretable and trustworthy AI systems represents an essential priority for clinical adoption (Jiménez-Luna et al., 2020; Preuer et al., 2019). Future work must move beyond post hoc explanation methods toward architectures that are inherently more interpretable, perhaps through modular designs with explicit reasoning components or hybrid systems that combine neural networks with symbolic reasoning. Uncertainty quantification that accurately captures model confidence and identifies out-of-distribution inputs could help clinicians calibrate their trust in AI recommendations appropriately. Current LLMs often exhibit poor calibration, expressing unwarranted confidence in incorrect predictions. Developing models that reliably know what they do not know would substantially improve their utility for high-stakes decisions.

Formal verification methods that can prove properties of neural network behavior may eventually provide stronger guarantees about model safety and reliability. While current verification techniques scale poorly to large models, advances in this area could enable deployment of AI systems in applications where empirical testing alone is insufficient assurance.

8.4 Multi-agent systems and autonomous research

The development of multi-agent LLM systems that can collaborate on complex biomedical problems represents an exciting frontier (Boiko et al., 2023; Bran et al., 2024; Park et al., 2023; Wang et al., 2024). Future systems may employ diverse specialized agents for different aspects of drug discovery and clinical research, including literature synthesis, hypothesis generation, experimental design, data analysis, and manuscript preparation. Coordination mechanisms that enable effective collaboration among agents while maintaining scientific rigor and ethical constraints will be essential. The integration of LLM-based reasoning with physical laboratory systems through robotic experimentation could create closed-loop discovery processes that iterate between computational prediction and experimental validation with minimal human intervention (Boiko et al., 2023). Such systems could accelerate scientific discovery by enabling rapid exploration of hypothesis spaces that would be impractical for human researchers. However, ensuring appropriate human oversight and maintaining scientific standards in increasingly autonomous research processes poses significant governance challenges.

Agent architectures that can learn and improve through experience, accumulating knowledge and refining strategies across research projects, could exhibit a form of scientific creativity that goes beyond pattern matching on training data. Whether such systems can generate genuinely novel scientific insights or are fundamentally limited to recombining existing knowledge remains an open question with profound implications for the future of scientific research.

8.5 Personalized and adaptive models

Future LLMs may be capable of continuous learning and adaptation to individual patient characteristics, enabling truly personalized medicine approaches that evolve with each patient interaction (Cui et al., 2024; Lotfollahi et al., 2019). Patient-specific models that incorporate an individual’s complete medical history, genomic profile, and lifestyle factors could provide highly tailored predictions and recommendations. Such personalization raises questions about validation requirements, as standard clinical trial methodologies may not be applicable to interventions that differ for each patient. Adaptive models that update based on treatment outcomes could learn which interventions work best for specific patient types, accumulating institutional knowledge that improves care quality over time. However, ensuring that adaptive systems remain safe and effective as they evolve requires novel approaches to monitoring and quality assurance that are not yet well established.

The integration of patient preferences and values into AI-driven decision support could enable shared decision making that respects patient autonomy while leveraging AI capabilities. Systems that can explain treatment options in terms patients understand and incorporate patient preferences into recommendations would represent a significant advance beyond current clinical decision support approaches.

8.6 Real-time clinical integration

Integration of LLMs into clinical workflows with real-time processing capabilities and seamless interoperability with electronic health record systems represents a near-term priority for translation (Rajkomar et al., 2018; Shickel et al., 2018). Efficient inference methods that enable responsive interaction without specialized hardware could facilitate deployment across diverse clinical settings. Standardized interfaces between AI systems and clinical information technology infrastructure would reduce implementation barriers and enable more rapid adoption. Edge deployment of compact, efficient models could bring AI capabilities to resource-limited settings including community health centers, rural hospitals, and low-income countries where centralized cloud computing may not be feasible or affordable. Developing models that maintain acceptable performance while fitting within severe computational constraints represents an important technical challenge with significant equity implications.

Real-time monitoring of patient status through continuous analysis of physiological data streams, laboratory results, and clinical documentation could enable earlier detection of deterioration and more timely intervention. Integration of such monitoring with clinical alerting systems requires careful attention to alert fatigue and workflow integration to ensure that AI-generated alerts are actionable and effective.

8.7 Regulatory science and validation frameworks

The development of appropriate regulatory frameworks and validation methodologies for AI in healthcare represents a critical enabler for clinical deployment (Gerke et al., 2020). Standardized benchmarks that reflect clinically meaningful outcomes, rather than purely technical metrics, would provide more relevant assessments of clinical utility. Prospective clinical trials of AI-based interventions, while resource-intensive, may be necessary to establish evidence of benefit for high-stakes applications. Regulatory approaches that accommodate continuously learning systems while maintaining safety standards are needed to enable deployment of adaptive AI. Current regulatory frameworks largely assume static devices that are validated once and deployed without change, an assumption that does not apply to systems designed to improve with experience. Developing appropriate oversight mechanisms for dynamic AI systems is an active area of regulatory science.

International harmonization of regulatory requirements could reduce barriers to global deployment of AI-based medical technologies. Currently, varying requirements across jurisdictions create complexity for developers and may delay access to beneficial technologies in some regions. Efforts toward convergence on core principles while respecting legitimate national differences could accelerate safe adoption worldwide.

8.8 Interdisciplinary collaboration and workforce development

Realizing the potential of LLMs in drug discovery and precision medicine requires sustained interdisciplinary collaboration among computer scientists, biologists, chemists, clinicians, ethicists, and policymakers (Wang et al., 2023). Building teams with the diverse expertise needed to develop, validate, and deploy biomedical AI systems represents an organizational challenge that extends beyond purely technical considerations. Workforce development programs that train researchers and clinicians in AI methods, and conversely train AI researchers in biomedical science, could expand the talent pool available to work on these problems. Educational curricula that prepare students for careers at the intersection of AI and biomedicine are beginning to emerge but require continued development and scaling. Community resources including shared datasets, benchmark tasks, and open-source software tools accelerate progress by enabling researchers to build on each other’s work rather than duplicating effort. Continued investment in such resources, along with incentive structures that reward sharing and collaboration, could substantially accelerate the field.

9 Conclusion

The body of work surveyed here shows that large language models have moved from proofs of concept to a set of practical instruments that intersect nearly every stage of drug discovery and precision medicine. The more interesting question is no longer whether these models can learn from molecules, sequences, and clinical text, but how the field should invest to make their outputs dependable enough for decisions that affect patients.

Several priorities follow from the evidence assembled in this review. First, evaluation must shift from in-distribution benchmark accuracy toward prospective, cold-split, and real-world validation, particularly for drug-target prediction, generative chemistry, and clinical decision support, where reported gains frequently shrink under realistic conditions. Second, grounding mechanisms such as retrieval augmentation, knowledge-graph constraints, and calibrated uncertainty should be treated as first-class design requirements rather than optional add-ons, given how consequential hallucination and overconfidence can be in biomedical use. Third, privacy-preserving training regimes such as federated and differentially private learning need to mature alongside governance frameworks that can keep pace with continually updated models.

Looking ahead, the most productive trajectories appear to be multi-agent systems that couple LLM reasoning with experimental automation, multi-modal foundation models that integrate molecular, cellular, imaging, and clinical data, and personalized models that adapt over a patient’s trajectory. Realizing these trajectories will require sustained collaboration among computational scientists, chemists, clinicians, regulators, and ethicists, and an honest accounting of both achievements and failure modes. If pursued with that balance of ambition and rigor, LLMs can plausibly become durable partners in biomedical discovery rather than a passing wave of benchmark results.

Generative AI statement

The author(s) declared that generative AI was not used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Glossary

Artificial intelligence and machine learning

AI Artificial Intelligence API Application Programming Interface AUROC Area Under the Receiver Operating Characteristic Curve AUPRC Area Under the Precision-Recall Curve BERT Bidirectional Encoder Representations from Transformers BPE Byte-Pair Encoding CNN Convolutional Neural Network GNN Graph Neural Network GPT Generative Pre-trained Transformer GPU Graphics Processing Unit LLM Large Language Model LoRA Low-Rank Adaptation MAE Mean Absolute Error ML Machine Learning MLM Masked Language Modeling MPNN Message Passing Neural Network NER Named Entity Recognition NLP Natural Language Processing OOD Out-of-Distribution QA Question Answering RAG Retrieval-Augmented Generation RLHF Reinforcement Learning from Human Feedback RMSE Root Mean Squared Error RNN Recurrent Neural Network SOTA State-of-the-Art VAE Variational Autoencoder XAI Explainable Artificial Intelligence

Drug discovery and chemistry

ADMET Absorption, Distribution, Metabolism, Excretion, and Toxicity DDI Drug-Drug Interaction DDR1 Discoidin Domain Receptor 1 DTI Drug-Target Interaction EGFR Epidermal Growth Factor Receptor GENTRL Generative Tensorial Reinforcement Learning GPCR G Protein-Coupled Receptor JAK Janus Kinase QSAR Quantitative Structure-Activity Relationship SMILES Simplified Molecular Input Line Entry System TNIK TRAF2 and NCK-Interacting Kinase

Clinical and regulatory

AML Acute Myeloid Leukemia CDSS Clinical Decision Support System ECG Electrocardiogram ECM Extracellular Matrix EHR Electronic Health Record EMA European Medicines Agency FDA Food and Drug Administration GDPR General Data Protection Regulation HIPAA Health Insurance Portability and Accountability Act ICD International Classification of Diseases ICH International Council for Harmonisation IND Investigational New Drug MDR Medical Device Regulation SaMD Software as a Medical Device USMLE United States Medical Licensing Examination VUS Variants of Uncertain Significance

Genomics and molecular biology

BRCA1/2 Breast Cancer gene 1 and 2 CYP2C19 Cytochrome P450 2C19 CYP2D6 Cytochrome P450 2D6 DNA Deoxyribonucleic Acid ESM Evolutionary Scale Modeling mRNA Messenger Ribonucleic Acid pLDDT Predicted Local Distance Difference Test RNA Ribonucleic Acid scGen single-cell Gene expression Generator

Databases and resources

ChEMBL Chemical European Molecular Biology Laboratory database MIMIC Medical Information Mart for Intensive Care PubMed Public Medicine database TDC Therapeutics Data Commons UniProt Universal Protein Resource

Footnotes

Edited by: Rodolpho C. Braga, InsilicAll, Brazil

Reviewed by: Ruchi Yadav, Amity University, India

Kumararaja K., New Prince Shri Bhavani College of Engineering and Technology, India

Statements

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Funding

The author(s) declared that financial support was received for this work and/or its publication. This work was supported by the National Institutes of Health (NIGMS R01GM157589) and the Department of Defense (DEPSCoR FA9550-22-1-0379).

Author contributions

HH: Conceptualization, Data curation, Formal Analysis, Methodology, Software, Visualization, Writing – original draft, Writing – review and editing. WR: Funding acquisition, Investigation, Project administration, Resources, Supervision, Validation, Writing – review and editing.

References

  1. Ahmad W., Simon E., Chithrananda S., Grand G., Ramsundar B. (2022). Chemberta-2: Towards Chemical Foundation Models. arXiv preprint arXiv:2209.01712. doi:10.48550/arXiv.2209.01712
  2. Alsentzer E., Murphy J. R., Boag W., Weng W.-H., Jin D., Naumann T. (2019). Publicly Available Clinical Bert Embeddings. arXiv preprint arXiv:1904.03323. doi:10.48550/arXiv.1904.03323
  3. Attia Z. I., Kapa S., Lopez-Jimenez F., McKie P. M., Ladewig D. J., Satam G. (2019). Screening for cardiac contractile dysfunction using an artificial intelligence-enabled electrocardiogram. Nat. Med. 25, 70 – 74. doi:10.1038/s41591-018-0240-2
  4. Bagal V., Aggarwal R., Vinod P., Priyakumar U. D. (2022). Molgpt: molecular generation using a transformer-decoder model. J. Chem. Inf. Model. 62, 2064 – 2076. doi:10.1021/acs.jcim.1c00600
  5. Bilodeau C., Jin W., Jaakkola T., Barzilay R., Jensen K. F. (2022). Generative models for molecular discovery: recent advances and challenges. Wiley Interdiscip. Rev. Comput. Mol. Sci. 12, e1608. doi:10.1002/wcms.1608
  6. Boiko D. A., MacKnight R., Kline B., Gomes G. (2023). Autonomous chemical research with large language models. Nature 624, 570 – 578. doi:10.1038/s41586-023-06792-0
  7. Bolton E., Venigalla A., Yasunaga M., Hall D., Xiong B., Lee T. (2024). Biomedlm: A 2.7 B Parameter Language Model Trained on Biomedical Text. arXiv preprint arXiv:2403.18421. doi:10.48550/arXiv.2403.18421
  8. Bonner S., Barrett I. P., Ye C., Swiers R., Sherrer A., Sherrer E. (2022). A review of biomedical datasets relating to drug discovery: a knowledge graph perspective. Briefings Bioinforma. 23, bbac404. doi:10.1093/bib/bbac404
  9. Born J., Manica M. (2023). Regression transformer enables concurrent sequence regression and generation for molecular language modelling. Nat. Mach. Intell. 5, 432 – 444. doi:10.1038/s42256-023-00639-z
  10. Born J., Manica M., Cadow J., Markert G., Mill N. A., Fradez M. (2021). PaccmannRL: designing anticancer drugs from transcriptomic data via reinforcement learning. J. Chem. Inf. Model. 61, 3319. doi:10.1007/978-3-030-45257-5_18
  11. Bran A. M., Cox S., Schilter O., Baldassari C., White A. D., Schwaller P. (2024). Chemcrow: augmenting large-language models with chemistry tools. Nat. Mach. Intell. 6, 525. doi:10.1038/s42256-024-00832-8
  12. Brown T., Mann B., Ryder N., Subbiah M., Kaplan J. D., Dhariwal P. (2020). Language models are few-shot learners. Adv. Neural Inf. Process. Syst. 33, 1877. doi:10.48550/ARXIV.2005.14165
  13. Budler L. C., Chen H., Chen A., Topaz M., Tam W., Bian J. (2025). A brief review on benchmarking for large language models evaluation in healthcare. WIREs Data Min. Knowl. Discov. 15, e70010. doi:10.1002/widm.70010
  14. Cai F., Zacour K., Zhu T., Tzeng T.-R., Duan Y., Liu L. (2025). ChemFM as a Scaling Law Guided Foundation Model Pre-trained on Informative Chemicals. arXiv preprint arXiv:2410.21422. doi:10.48550/arXiv.2410.21422
  15. Cao H., Liu Z., Lu X., Yao Y., Li Y. (2023). Instructmol: Multi-Modal Integration for Building a Versatile and Reliable Molecular Assistant in Drug Discovery. arXiv preprint arXiv:2311.16208. doi:10.48550/arXiv.2311.16208
  16. Char D. S., Shah N. H., Magnus D. (2018). Implementing machine learning in health care—addressing ethical challenges. N. Engl. J. Med. 378, 981 – 983. doi:10.1056/NEJMp1714229
  17. Chaves J. M. Z., Wang E., Tu T., Vaishnav E. D., Lee B., Mahdavi S. S. (2024). Tx-LLM: A Large Language Model for Therapeutics. arXiv preprint arXiv:2406.06316. doi:10.48550/arXiv.2406.06316
  18. Chen L., Tan X., Wang D., Zhong F., Liu X., Yang T. (2020). Transformercpi: improving compound-protein interaction prediction by sequence-based deep learning with self-attention mechanism and label reversal experiments. Bioinformatics 36, 4406 – 4414. doi:10.1093/bioinformatics/btaa524
  19. Chen Z., Hernández-Cano A., Romanou A., Bonber A., Matoba K., Salvi F. (2023). Meditron-70b: Scaling Medical Pretraining for Large Language Models. arXiv preprint arXiv:2311.16079. doi:10.48550/arXiv.2311.16079
  20. Chithrananda S., Grand G., Ramsundar B. (2020). Chemberta: Large-Scale Self-Supervised Pretraining for Molecular Property Prediction. arXiv preprint arXiv:2010.09885. doi:10.48550/arXiv.2010.09885
  21. Chitsaz K., Balaji R., Fournier Q., Bhatt N. P., Chandar S. (2025). NovoMolGen: Rethinking Molecular Language Model Pretraining. arXiv preprint arXiv:2508.13408. doi:10.48550/arXiv.2508.13408
  22. Chon J., Zheng K., Chan G., Ho J. (2017). Automation and machine learning: a look into recursion pharmaceuticals. ResearchGate. doi:10.13140/RG.2.2.19921.43368
  23. Chowdhery A., Narang S., Devlin J., Bosma M., Mishra G., Roberts A. (2023). Palm: scaling language modeling with pathways. J. Mach. Learn. Res. 24, 1. doi:10.48550/ARXIV.2204.02311
  24. Clark M. M., Stark Z., Farnaes L., Tan T. Y., White S. M., Dimmock D. (2019). Diagnosis of genetic diseases in seriously ill children by rapid whole-genome sequencing and automated phenotyping and interpretation. Sci. Transl. Med. 11, eaat6177. doi:10.1126/scitranslmed.aat6177
  25. Corso G., Stärk H., Jing B., Barzilay R., Jaakkola T. (2023). Diffdock: Diffusion Steps, Twists, and Turns for Molecular Docking. arXiv preprint arXiv:2210.01776. doi:10.48550/arXiv.2210.01776
  26. Cui H., Wang C., Maan H., Pang K., Luo F., Duan N. (2024). scgpt: toward building a foundation model for single-cell multi-omics using generative ai. Nat. Methods 21, 1470 – 1480. doi:10.1038/s41592-024-02201-0
  27. Dalla-Torre H., Gonzalez L., Mendoza-Revilla J., Carranza N. L., Grzywaczewski A. H., Ober F. (2023). The nucleotide transformer: building and evaluating robust foundation models for human genomics. bioRxiv. doi:10.1101/2023.01.11.523679
  28. Dayan I., Roth H. R., Zhong A., Harouni A., Gentili A., Abidin A. Z. (2021). Federated learning for predicting clinical outcomes in patients with covid-19. Nat. Med. 27, 1735 – 1743. doi:10.1038/s41591-021-01506-3
  29. Devlin J., Chang M.-W., Lee K., Toutanova K. (2019). Bert: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805. doi:10.48550/arXiv.1810.04805
  30. DiMasi J. A., Grabowski H. G., Hansen R. W. (2016). Innovation in the pharmaceutical industry: new estimates of r&d costs. J. Health Econ. 47, 20 – 33. doi:10.1016/j.jhealeco.2016.01.012
  31. Edwards C., Lai T., Ros K., Honber G., Cho K., Ji H. (2022a). Translation between Molecules and Natural Language. arXiv preprint arXiv:2204.11817. doi:10.48550/arXiv.2204.11817
  32. Edwards C., Lai T., Ros K., Honke G., Cho K., Ji H. (2022b). Translation between molecules and natural language. EMNLP. doi:10.18653/v1/2022.emnlp-main.26
  33. Elnaggar A., Heinzinger M., Dallago C., Rehawi G., Wang Y., Jones L. (2021). Prottrans: toward understanding the language of life through self-supervised learning. IEEE Trans. Pattern Analysis Mach. Intell. 44, 7112 – 7127. doi:10.1109/tpami.2021.3095381
  34. Esteva A., Robicquet A., Ramsundar B., Kuleshov V., DePristo M., Chou K. (2019). A guide to deep learning in healthcare. Nat. Med. 25, 24 – 29. doi:10.1038/s41591-018-0316-z
  35. Fang J., Piber T., Fei F., Zhang P., Cai Y., Xu J. (2021). Endophenotype-based in silico network medicine discovery combined with insurance record data mining identifies sildenafil as a candidate drug for alzheimer’s disease. Nat. Aging 1, 1175 – 1188. doi:10.1038/s43587-021-00138-z
  36. Fang Y., Liang X., Zhang N., Liu K., Huang R., Chen Z. (2023). Mol-instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Models. arXiv preprint arXiv:2306.08018. doi:10.48550/arXiv.2306.08018
  37. Ferruz N., Schmidt S., Höcker B. (2022). Protgpt2 is a deep unsupervised language model for protein design. Nat. Commun. 13, 4348. doi:10.1038/s41467-022-32007-7
  38. Frey N. C., Soklaski R., Axelrod S., Samsi S., Gber-Mber R., Coley C. (2023). Neural scaling of deep chemical models. Nat. Mach. Intell. 5, 1297 – 1305. doi:10.1038/s42256-023-00740-3
  39. Gerke S., Minssen T., Cohen G. (2020). “ Ethical and legal challenges of artificial intelligence-driven healthcare ”, Artificial Intelligence in Healthcare (Elsevier), 295 – 336. doi:10.1016/B978-0-12-818438-7.00012-5
  40. Gómez-Bombarelli R., Wei J. N., Duvenaud D., Hernández-Lobato J. M., Sánchez-Lengeling B., Sheberla D. (2018). Automatic chemical design using a data-driven continuous representation of molecules. ACS Central Sci. 4, 268 – 276. doi:10.1021/acscentsci.7b00572
  41. Gu Y., Tinn R., Cheng H., Lucas M., Usuyama N., Liu X. (2021). Domain-specific language model pretraining for biomedical natural language processing. ACM Trans. Comput. Healthc. 3, 1 – 23. doi:10.1145/3458754
  42. Guevorguian P., Bedrosian M., Fahradyan T., Chilingaryan G., Khachatrian H., Aghajanyan A. (2024). Small Molecule Optimization with Large Language Models. arXiv preprint arXiv:2407.18897. doi:10.48550/arXiv.2407.18897
  43. Gysi D. M., Do Valle I., Zitnik M., Ameli A., Gan X., Varol O. (2021). Network medicine framework for identifying drug-repurposing opportunities for covid-19. Proc. Natl. Acad. Sci. 118, e2025581118. doi:10.1073/pnas.2025581118
  44. Han T., Adams L. C., Papaioannou J.-M., Grundmann P., Oberhauser T., Löser A. (2023). Medalpaca – an Open-Source Collection of Medical Conversational Ai Models and Training Data. arXiv preprint arXiv:2304.08247. doi:10.48550/arXiv.2304.08247
  45. Hays H. (2026a). Attention Mechanisms in Neural Networks. arXiv. doi:10.48550/arxiv.2601.03329
  46. Hays H. (2026b). Resonant Sparse Geometry Networks. arXiv. doi:10.48550/ARXIV.2601.18064
  47. Hays H., Richardson W. J. (2026a). Rag-gnn: Integrating Retrieved Knowledge with Graph Neural Networks for Precision Medicine. arXiv. doi:10.48550/arXiv.2602.00586
  48. Hays H., Richardson W. J. (2026b). Ecmsim: a high-performance interactive web application for real-time spatiotemporal simulation of cardiac ecm signaling and diffusion. Matrix Biol. Plus 30, 100195. doi:10.1016/j.mbplus.2026.100195
  49. Hays H., Gu Z., Mai K., Zhang W. (2023). Transcriptome-based nutrigenomics analysis reveals the roles of dietary taurine in the muscle growth of juvenile turbot (scophthalmus maximus). Comp. Biochem. Physiology Part D Genomics Proteomics 47, 101120. doi:10.1016/j.cbd.2023.101120
  50. Hays H., Yu Y., Richardson W. J. (2025). Hierarchical Molecular Language Models (Hmlms). arXiv. doi:10.48550/arxiv.2512.00696
  51. Hernandez E., Mahajan D., Wulff J., Smith M. J., Ziegler Z., Nadler D. (2023). “ Do We Still Need Clinical Language Models? ”, in Conference on Health, Inference, and Learning (PMLR), 578 – 597.
  52. Hoogeboom E., Satorras V. G., Vignac C., Welling M. (2022). Equivariant Diffusion for Molecule Generation in 3d. arXiv preprint arXiv:2203.17003. doi:10.48550/arXiv.2203.17003
  53. Huang K., Xiao C., Glass L. M., Sun J. (2021). Moltrans: molecular interaction transformer for drug–target interaction prediction. Bioinformatics 37, 830. doi:10.1093/bioinformatics/btaa880
  54. Huang X-T., Jia S., Gao L., Wu J. (2022). Reconstruction of human protein-coding gene functional association network based on machine learning. Brief. Bioinform. 23 (2). doi:10.1093/bib/bbab552
  55. Inoue Y., Song T., Wang X., Luna A., Fu T. (2025). DrugAgent: Multi-Agent Large Language Model-Based Reasoning for Drug-Target Interaction Prediction. arXiv preprint arXiv:2408.13378. doi:10.48550/arXiv.2408.13378
  56. Irwin R., Dimitriadis S., He J., Bjerrum E. J. (2022). Chemformer: a pre-trained transformer for computational chemistry. Mach. Learn. Sci. Technol. 3, 015022. doi:10.1088/2632-2153/ac3ffb
  57. Jayatunga M. K. P., Ayers M., Bruens L., Jayanth D., Meier C. (2024). How successful are AI-discovered drugs in clinical trials? A first analysis and emerging lessons. Drug Discov. Today 29, 104009. doi:10.1016/j.drudis.2024.104009
  58. Ji Y., Zhou Z., Liu H., Davuluri R. V. (2021). Dnabert: pre-trained bidirectional encoder representations from transformers model for dna-language in genome. Bioinformatics 37, 2112 – 2120. doi:10.1093/bioinformatics/btab083
  59. Jiang P., Gu S., Pan D., Fu J., Sahu A., Hu X. (2018). Signatures of t cell dysfunction and exclusion predict cancer immunotherapy response. Nat. Med. 24, 1550 – 1558. doi:10.1038/s41591-018-0136-1
  60. Jiménez-Luna J., Grisoni F., Schneider G. (2020). Drug discovery with explainable artificial intelligence. Nat. Mach. Intell. 2, 573 – 584. doi:10.1038/s42256-020-00236-4
  61. Jin W., Barzilay R., Jaakkola T. (2018). Junction Tree Variational Autoencoder for Molecular Graph Generation. arXiv preprint arXiv:1802.04364. doi:10.48550/arXiv.1802.04364
  62. Jin Q., Yang Y., Chen Q., Lu Z. (2023). Genegpt: augmenting large language models with domain tools for improved access to biomedical information. Bioinformatics 40, btad708. doi:10.1093/bioinformatics/btae075
  63. Kojima T., Gu S. S., Reid M., Matsuo Y., Iwasawa Y. (2022). Large language models are zero-shot reasoners. Adv. Neural Inf. Process. Syst. 35, 22199. doi:10.48550/ARXIV.2205.11916
  64. Kung T. H., Cheatham M., Medenilla A., Sillos C., De Leon L., Elepaño C. (2023). Performance of chatgpt on usmle: potential for ai-assisted medical education using large language models. PLOS Digit. Health 2, e0000198. doi:10.1371/journal.pdig.0000198
  65. Lee J., Yoon W., Kim S., Kim D., Kim S., So C. H. (2020). Biobert: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 1234 – 1240. doi:10.1093/bioinformatics/btz682
  66. Lee P., Bubeck S., Petro J. (2023). Benefits, limits, and risks of gpt-4 as an ai chatbot for medicine. N. Engl. J. Med. 388, 1233 – 1239. doi:10.1056/nejmsr2214184
  67. Lewis P., Perez E., Piktus A., Petroni F., Karpukhin V., Goyal N. (2020). Retrieval-augmented generation for knowledge-intensive nlp tasks. Adv. Neural Inf. Process. Syst. 33, 9459. doi:10.48550/arXiv.2005.11401
  68. Li Y., Gao C., Song X., Wang X., Xu Y., Han S. (2023). Druggpt: a gpt-based strategy for designing potential ligands targeting specific proteins. bioRxiv. doi:10.1101/2023.06.29.543848
  69. Li P.-H., Sun Y.-Y., Juan H.-F., Chen C.-Y., Tsai H.-K., Huang J.-H. (2024a). A large language model framework for literature-based disease–gene association prediction. Briefings Bioinforma. 26, bbaf070. doi:10.1093/bib/bbaf070
  70. Li D., Yang Y., Cui Z., Yin H., Hu P., Hu L. (2024b). LLM-DDI: leveraging large language models for drug-drug interaction prediction on biomedical knowledge graph. IEEE J. Biomed. Health Inf. 30, 773 – 781. doi:10.1109/jbhi.2025.3585290
  71. Liang Y., Zhang R., Zhang L., Xie P. (2023). Drugchat: towards enabling chatgpt-like capabilities on drug molecule graphs. TechRxiv Preprint. doi:10.36227/techrxiv.22945922
  72. Lin Z., Akin H., Rao R., Hie B., Zhu Z., Lu W. (2023). Evolutionary-scale prediction of atomic-level protein structure with a language model. Science 379, 1123 – 1130. doi:10.1126/science.ade2574
  73. Liu S., Nie W., Wang C., Lu J., Qiao Z., Liu L. (2023a). Multi-modal molecule structure–text model for text-based retrieval and editing. Nat. Mach. Intell. 5, 1447 – 1457. doi:10.1038/s42256-023-00759-6
  74. Liu X., Ye K., van Vlijmen H. W. T., Ijzerman A. P., van Westen G. J. P. (2023b). Drugex v3: scaffold-constrained drug design with graph transformer-based reinforcement learning. J. Cheminformatics 15, 24. doi:10.1186/s13321-023-00694-z
  75. Liu G., Zhang Y., Liu X., Yao Q., Case-based reasoning enhances the predictive power of LLMs in drug-drug interaction, arXiv preprint arXiv:2505.23034 2025). doi:10.48550/arXiv.2505.23034
  76. Lotfollahi M., Wolf F. A., Theis F. J. (2019). Scgen predicts single-cell perturbation responses. Nat. Methods 16, 715 – 721. doi:10.1038/s41592-019-0494-8
  77. Luo R., Sun L., Xia Y., Qin T., Zhang S., Poon H. (2022). Biogpt: generative pre-trained transformer for biomedical text generation and mining. Briefings Bioinforma. 23, bbac409. doi:10.1093/bib/bbac409
  78. Lyu Y., Wu Z., Zhang L., Zhang J., Li Y., Ruan W. (2024). GP-GPT: Large Language Model for Gene-Phenotype Mapping. arXiv preprint arXiv:2409.09825. doi:10.48550/arXiv.2409.09825
  79. Madani A., Krause B., Greene E. R., Subramanian S., Mohr B. P., Holton J. M. (2023). Large language models generate functional protein sequences across diverse families. Nat. Biotechnol. 41, 1099 – 1106. doi:10.1038/s41587-022-01618-2
  80. Mak K.-K., Pichika M. R. (2019). Artificial intelligence in drug development: present status and future prospects. Drug Discov. Today 24, 773 – 780. doi:10.1016/j.drudis.2018.11.014
  81. Mayr A., Klambauer G., Unterthiner T., Hochreiter S. (2016). Deeptox: toxicity prediction using deep learning. Front. Environ. Sci. 3, 80. doi:10.3389/fenvs.2015.00080
  82. Menden M. P., Wang D., Mason M. J., Szalai B., Bulusu K. C., Guan Y. (2019). Community assessment to advance computational prediction of cancer drug combinations in a pharmacogenomic screen. Nat. Commun. 10, 2674. doi:10.1038/s41467-019-09799-2
  83. Mendez D., Gaulton A., Bento A. P., Chambers J., De Veij M., Félix E. (2019). Chembl: towards direct deposition of bioassay data. Nucleic Acids Res. 47, D930. doi:10.1093/nar/gky1075
  84. Mittal S., Bjornevik K., Im D. S., Flierl A., Dong X., Locascio J. J. (2017). β 2-adrenoreceptor is a regulator of the α -synuclein gene driving risk of Parkinson’s disease. Science 357, 891 – 898. doi:10.1126/science.aaf3934
  85. Mohamed S. K., Novacek V., Nounu A. (2021). Biological applications of knowledge graph embedding models. Briefings Bioinforma. 22, 1679. doi:10.1093/bib/bbaa012
  86. Nguyen T., Le H., Quinn T. P., Nguyen T., Le T. D., Venkatesh S. (2021). Graphdta: predicting drug–target binding affinity with graph neural networks. Bioinformatics 37, 1140. doi:10.1093/bioinformatics/btaa921
  87. Nguyen E., Poli M., Faizi M., Thomas A., Birber-Massad C., Wornow M. (2024). Hyenadna: long-range genomic sequence modeling at single nucleotide resolution. Adv. Neural Inf. Process. Syst. 36. doi:10.48550/arXiv.2306.15794
  88. Nori H., King N., McKinney S. M., Carignan D., Horvitz E. (2023). Capabilities of Gpt-4 on Medical Challenge Problems. arXiv preprint arXiv:2303.13375. doi:10.48550/arXiv.2303.13375
  89. Noseworthy P. A., Attia Z. I., Brewer L. C., Hayes S. N., Yao X., Kapa S. (2020). Assessing and mitigating bias in medical artificial intelligence: the effects of race and ethnicity on a deep learning model for ecg analysis. Circulation Arrhythmia Electrophysiol. 13, e007988. doi:10.1161/CIRCEP.119.007988
  90. Obermeyer Z., Powers B., Vogeli C., Mullainathan S. (2019). Dissecting racial bias in an algorithm used to manage the health of populations. Science 366, 447 – 453. doi:10.1126/science.aax2342
  91. OpenAI (2023). GPT-4 Technical Report. arXiv preprint arXiv:2303.08774. doi:10.48550/arXiv.2303.08774
  92. Öztürk H., Özgür A., Ozkirimli E. (2018). Deepdta: deep drug–target binding affinity prediction. Bioinformatics 34, i821 – i829. doi:10.1093/bioinformatics/bty593
  93. Park J. S., O’Brien J. C., Cai C. J., Morris M. R., Liang P., Bernstein M. S. (2023). Generative Agents: Interactive Simulacra of Human Behavior. arXiv preprint arXiv:2304.03442. doi:10.48550/arXiv.2304.03442
  94. Park J., Park Y., Song M., Park S., Lee D., Baek S. (2025). CoTox: Chain-Of-Thought-Based Molecular Toxicity Reasoning and Prediction. arXiv preprint arXiv:2508.03159. doi:10.48550/arXiv.2508.03159
  95. Patel S. B., Lam K. (2023). Chatgpt: the future of discharge summaries? Lancet Digital Health 5, e107 – e108. doi:10.1016/s2589-7500(23)00021-3
  96. Pati S., Baid U., Edwards B., Sheller M., Wang S.-H., Reina G. A. (2022). Federated learning enables big data for rare cancer boundary detection. Nat. Commun. 13, 7346. doi:10.1038/s41467-022-33407-5
  97. Paul D., Sanap G., Shenoy S., Kalyane D., Kalia K., Tekade R. K. (2021). Artificial intelligence in drug discovery and development. Drug Discov. Today 26, 80. doi:10.1016/j.drudis.2020.10.010
  98. Peng Y., Yan S., Lu Z. (2019). Transfer Learning in Biomedical Natural Language Processing: An Evaluation of Bert and Elmo on Ten Benchmarking Datasets. arXiv preprint arXiv:1906.05474. doi:10.48550/arXiv.1906.05474
  99. Polykovskiy D., Zhebrak A., Sanchez-Lengeling B., Golovanov S., Tatanov O., Beez S. (2020). Molecular sets (moses): a benchmarking platform for molecular generation models. Front. Pharmacol. 11, 565644. doi:10.3389/fphar.2020.565644
  100. Preuer K., Lewis R. P., Hochreiter S., Bender A., Bulusu K. C., Klambauer G. (2018). Deepsynergy: predicting anti-cancer drug synergy with deep learning. Bioinformatics 34, 1538 – 1546. doi:10.1093/bioinformatics/btx806
  101. Preuer K., Klambauer G., Rippmann F., Hochreiter S., Unterthiner T. (2019). Interpretable deep learning in drug discovery. Briefings Bioinforma. 20, 1855. doi:10.48550/arXiv.1903.02788
  102. Pushpakom S., Iorio F., Eyers P. A., Escott K. J., Hopper S., Wells A. (2019). Drug repurposing: progress, challenges and recommendations. Nat. Rev. Drug Discov. 18, 41 – 58. doi:10.1038/nrd.2018.168
  103. Radford A., Wu J., Child R., Luan D., Amodei D., Sutskever I. (2019). Language models are unsupervised multitask learners. OpenAI Blog 1, 9. Available online at:
  104. Rajkomar A., Oren E., Chen K., Dai A. M., Hajaj N., Hardt M. (2018). Scalable and accurate deep learning with electronic health records. Npj Digit. Med. 1, 18. doi:10.1038/s41746-018-0029-1
  105. Richardson P., Griffin I., Tucker C., Smith D., Oechsle O., Phelan A. (2020). Baricitinib as potential treatment for 2019-ncov acute respiratory disease. Lancet 395, e30 – e31. doi:10.1016/S0140-6736(20)30304-4
  106. Rieke N., Hancox J., Li W., Milletari F., Roth H. R., Albarqouni S. (2020). The future of digital health with federated learning. Npj Digit. Med. 3, 119. doi:10.1038/s41746-020-00323-1
  107. Rives A., Meier J., Sercu T., Goyal S., Lin Z., Liu J. (2021). Biological structure and function emerge from scaling unsupervised learning to 250 million protein sequences. Proc. Natl. Acad. Sci. 118, e2016239118. doi:10.1073/pnas.2016239118
  108. Rodríguez-Pérez R., Bajorath J. (2020). Interpretation of machine learning models using shapley values: application to compound potency and multi-target activity predictions. J. Computer-Aided Mol. Des. 34, 1013 – 1026. doi:10.1007/s10822-020-00314-0
  109. Ross J., Belgodere B., Chenthamarakshan V., Hoffman S. C., Strobelt H., Das P. (2022). Large-scale chemical language representations capture molecular structure and properties. Nat. Mach. Intell. 4, 1256 – 1264. doi:10.1038/s42256-022-00580-7
  110. Saab K., Tu T., Weng W.-H., Tanno R., Stutz D., Wulczyn E. (2024). Capabilities of Gemini Models in Medicine, arXiv preprint arXiv:2404.18416. doi:10.48550/arXiv.2404.18416
  111. Santos R., Ursu O., Gaulton A., Bento A. P., Donadi R. S., Bologa C. G. (2017). A comprehensive map of molecular drug targets. Nat. Rev. Drug Discov. 16, 19 – 34. doi:10.1038/nrd.2016.230
  112. Schneider P., Walters W. P., Plowright A. T., Sber N., Schnber J., Schneider G. (2020). Rethinking drug design in the artificial intelligence era. Nat. Rev. Drug Discov. 19, 353 – 364. doi:10.1038/s41573-019-0050-3
  113. Schneuing A., Du Y., Harris C., Jamasb A., Igashov I., Du W. (2022). Structure-based Drug Design with Equivariant Diffusion Models. arXiv preprint arXiv:2210.13695. doi:10.48550/arXiv.2210.13695
  114. Schwaller P., Laino T., Gaudin T., Bolgar P., Hunter C. A., Bekas C. (2019). Molecular transformer: a model for uncertainty-calibrated chemical reaction prediction. ACS Central Sci. 5, 1572 – 1583. doi:10.1021/acscentsci.9b00576
  115. Segler M. H., Kogej T., Tyrchan C., Waller M. P. (2018). Generating focused molecule libraries for drug discovery with recurrent neural networks. ACS Central Sci. 4, 120 – 131. doi:10.1021/acscentsci.7b00512
  116. Shickel B., Tighe P. J., Bihorac A., Rashidi P. (2018). Deep ehr: a survey of recent advances in deep learning techniques for electronic health record (ehr) analysis. IEEE J. Biomed. Health Inf. 22, 1589 – 1604. doi:10.1109/JBHI.2017.2767063
  117. Si Y., Du J., Li Z., Jiang X., Miller T., Wang F. (2021). Deep representation learning of patient data from electronic health records (ehr): a systematic review. J. Biomed. Inf. 115, 103671. doi:10.1016/j.jbi.2020.103671
  118. Singhal K., Azizi S., Tu T., Mahdavi S. S., Wei J., Chung H. W. (2023). Large language models encode clinical knowledge. Nature 620, 172 – 180. doi:10.1038/s41586-023-06291-2
  119. Song B., Li X., Chao X., Wang L., Liu Y., Xia Z. (2025). Advancements in large language models (llms): empowering drug discovery. WIREs Comput. Mol. Sci. 15, e70054. doi:10.1002/wcms.70054
  120. Stokes J. M., Yang K., Swanson K., Jin W., Cubillos-Ruiz A., Donghia N. M. (2020). A deep learning approach to antibiotic discovery. Cell 180, 688 – 702. doi:10.1016/j.cell.2020.01.021
  121. Sun K., Bagni D., Cavanagh J. M., Wang Y., Sawyer J. M., Zhou B. (2025). SynLlama: Generating Synthesizable Molecules and Their Analogs with Large Language Models. arXiv preprint arXiv:2503.12602. doi:10.48550/arXiv.2503.12602
  122. Tatonetti N. P., Ye P. P., Daneshjou R., Altman R. B. (2012). Data-driven prediction of drug effects and interactions. Sci. Transl. Med. 4, 125ra31. doi:10.1126/scitranslmed.3003377
  123. Tavtigian S. V., Greenblatt M. S., Harrison S. M., Nussbaum R. L., Prabhu S. A., Boucher L. M. (2018). Modeling the acmg/amp variant classification guidelines as a bayesian classification framework. Genet. Med. 20, 1054 – 1060. doi:10.1038/gim.2017.210
  124. Taylor R., Kardas M., Cucurull G., Scialom T., Hartshorn A., Saravia E. (2022). Galactica: A Large Language Model for Science. arXiv preprint arXiv:2211.09085. doi:10.48550/arXiv.2211.09085
  125. Theodoris C. V., Xiao L., Chopra A., Chaffin M. D., Al Sayed Z. R., Hill M. C. (2023). Transfer learning enables predictions in network biology. Nature 618, 616 – 624. doi:10.1038/s41586-023-06139-9
  126. Thirunavukarasu A. J., Ting D. S. W., Elangovan K., Gutierrez L., Tan T. F., Ting D. S. W. (2023). Large language models in medicine. Nat. Med. 29, 1930 – 1940. doi:10.1038/s41591-023-02448-8
  127. Touvron H., Lavril T., Izacard G., Martinet X., Lachaux M.-A., Lacroix T. (2023a). Llama: Open and Efficient Foundation Language Models. arXiv preprint arXiv:2302.13971. doi:10.48550/arXiv.2302.13971
  128. Touvron H., Martin L., Stone K., Albert P., Almahairi A., Babaei Y. (2023b). Llama 2: Open Foundation and Fine-Tuned Chat Models. arXiv preprint arXiv:2307.09288. doi:10.48550/arXiv.2307.09288
  129. Tyler N. S., Mosquera-Lopez C. M., Wilson L. M., Dodier R. H., Branigan D. L., Gabo V. B. (2020). An artificial intelligence decision support system for more accurate glucose prediction in type 1 diabetes. Nat. Med. 26, 1261. doi:10.1038/s42255-020-0212-y
  130. Vamathevan J., Clark D., Czodrowski P., Dunham I., Ferran E., Lee G. (2019). Applications of machine learning in drug discovery and development. Nat. Rev. Drug Discov. 18, 463 – 477. doi:10.1038/s41573-019-0024-5
  131. Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A. N. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst. 30. doi:10.48550/arXiv.1706.03762
  132. Wang Z., Sun J. (2022). Trial2vec: zero-shot clinical trial document similarity search using self-supervision. ArXiv, 5868. doi:10.18653/v1/2022.findings-emnlp.476
  133. Wang H., Fu T., Du Y., Gao W., Huang K., Liu Z. (2023). Scientific discovery in the age of artificial intelligence. Nature 620, 47 – 60. doi:10.1038/s41586-023-06221-2
  134. Wang L., Ma C., Feng X., Zhang Z., Yang H., Zhang J. (2024). A survey on large language model based autonomous agents. Front. Comput. Sci. 18, 186345. doi:10.1007/s11704-024-40231-1
  135. Wang H., Skreta M., Ser C.-T., Gao W., Kong L., Strieth-Kalthoff F. (2025a). Efficient Evolutionary Search Over Chemical Space With Large Language Models, arXiv preprint arXiv:2406.16976. doi:10.48550/arXiv.2406.16976
  136. Wang E., Schmidgall S., Jaeger P. F., Zhang F., Pilgrim R., Matias Y. (2025b). TxGemma: Efficient and Agentic LLMs for Therapeutics. arXiv preprint arXiv:2504.06196. doi:10.48550/arXiv.2504.06196
  137. Wei J., Wang X., Schuurmans D., Bosma M., Ichter B., Xia F. (2022). Chain-of-thought prompting elicits reasoning in large language models. Adv. Neural Inf. Process. Syst. 35, 24824. doi:10.48550/arXiv.2201.11903
  138. Wei J., Zhuo L., Fu X., Zeng X., Wang L., Zou Q. (2024). DrugReAlign: a multisource prompt framework for drug repurposing based on large language models. BMC Biol. 22, 226. doi:10.1186/s12915-024-02028-3
  139. Wishart D. S., Feunang Y. D., Guo A. C., Lo E. J., Marcu A., Grant J. R. (2018). Drugbank 5.0: a major update to the drugbank database for 2018. Nucleic Acids Res. 46, D1074. doi:10.1093/nar/gkx1037
  140. Wouters O. J., McKee M., Luyten J. (2020). Estimated research and development investment needed to bring a new medicine to market, 2009-2018. JAMA 323, 844 – 853. doi:10.1001/jama.2020.1166
  141. Wu Z., Ramsundar B., Feinberg E. N., Gomes J., Geniesse C., Pappu A. S. (2018). Moleculenet: a benchmark for molecular machine learning. Chem. Sci. 9, 513 – 530. doi:10.1039/c7sc02664a
  142. Xian Z., Gu J., Li L., Liang S. (2025). “ MolRAG: unlocking the power of large language models for molecular property prediction,” in Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) (Vienna, Austria: Association for Computational Linguistics), 15513 – 15531.
  143. Xiong Z., Wang D., Liu X., Zhong F., Wan X., Li X. (2020). Pushing the boundaries of molecular representation for drug discovery with the graph attention mechanism. J. Med. Chem. 63, 8749 – 8760. doi:10.1021/acs.jmedchem.9b00959
  144. Xiong G., Jin Q., Lu Z., Zhang A. (2024). Benchmarking Retrieval-Augmented Generation for Medicine. arXiv preprint arXiv:2402.13178. doi:10.48550/arXiv.2402.13178
  145. Xu M., Yu L., Song Y., Shi C., Ermon S., Tang J. (2022). Geodiff: A Geometric Diffusion Model for Molecular Conformation Generation. arXiv preprint arXiv:2203.02923. doi:10.48550/arXiv.2203.02923
  146. Xu C., Bulusu K. C., Pan H., Elemento O. (2024). DDI-GPT: explainable prediction of drug-drug interactions using large language models enhanced with knowledge graphs. bioRxiv. doi:10.1101/2024.12.06.627266
  147. Xu Z., Ren F., Wang P., Cao J., Tan C., Ma D. (2025). A generative AI-discovered TNIK inhibitor for idiopathic pulmonary fibrosis: a randomized phase 2a trial. Nat. Med. 31, 2602 – 2610. doi:10.1038/s41591-025-03743-2
  148. Yang K., Swanson K., Jin W., Coley C., Eiden P., Gao H. (2019). Analyzing learned molecular representations for property prediction. J. Chem. Inf. Model. 59, 3370 – 3388. doi:10.1021/acs.jcim.9b00237
  149. Yang X., Chen A., PourNejatian N., Shin H. C., Smith K. E., Parisien C. (2022). A large language model for electronic health records. Npj Digit. Med. 5, 194. doi:10.1038/s41746-022-00742-2
  150. Yazdani-Jahromi M., Yousefi N., Tayebi A., Kolber E., Neal C. J., Seal S. (2022). AttentionSiteDTI: an interpretable graph-based model for drug-target interaction prediction using NLP sentence-level relation classification. Brief. Bioinform. 23 (4), bbac272. doi:10.1093/bib/bbac272
  151. Ye G., Cai X., Lai H., Wang X., Huang J., Wang L. (2024). DrugAssist: A Large Language Model for Molecule Optimization. arXiv preprint arXiv:2401.10334. doi:10.48550/arXiv.2401.10334
  152. Yu O. H. Y., Suissa S. (2023). Metformin and cancer: solutions to a real-world evidence failure. Diabetes Care 46 (5), 904 – 912. doi:10.2337/dci22-0047
  153. Yu J., Zheng Y., Koh H. Y., Pan S., Wang T., Wang H. (2025). Collaborative Expert LLMs Guided Multi-Objective Molecular Optimization. arXiv preprint arXiv:2503.03503. doi:10.48550/arXiv.2503.03503
  154. Yuan C., Ryan P. B., Ta C., Guo Y., Li Z., Hardin J. (2019). Criteria2query 2.0: a natural language interface to clinical trial eligibility criteria. J. Am. Med. Inf. Assoc. 26, (4), 294 – 305. doi:10.1093/jamia/ocy178
  155. Yue J., Peng B., Chen Y., Jin J., Zhao X., Shen C. (2024). Unlocking comprehensive molecular design across all scenarios with large language model and unordered chemical language. Chem. Sci. 15, 13727 – 13740. doi:10.1039/d4sc03744h
  156. Zaidi S., Gandhi J., Joshi G., Smith N. L., Khan S. A. (2019). The anticancer potential of metformin on prostate cancer. Prostate Cancer Prostatic Dis. 22 (3), 351 – 361. doi:10.1038/s41391-018-0085-2
  157. Zakka C., Shad R., Chaurasia A., Dalber A., Kim J., Mber M. (2024). Almanac: retrieval-augmented language models for clinical medicine. NEJM AI 1 (2). doi:10.1056/AIoa2300068
  158. Zeng X., Song X., Ma T., Pan X., Zhou Y., Hou Y. (2020). Repurpose open data to discover therapeutics for covid-19 using deep learning. J. Proteome Res. 19, 4624 – 4636. doi:10.1021/acs.jproteome.0c00316
  159. Zeng Z., Yin B., Wang S., Liu J., Yang C., Yao H. (2024). ChatMol: interactive molecular discovery with natural language. Bioinformatics 40, btae534. doi:10.1093/bioinformatics/btae534
  160. Zhang K., Zhou R., Adhikarla E., Yan Z., Lui Y., Yu J. (2024). Biomedgpt: A Unified and Generalist Biomedical Generative Pre-trained Transformer for Vision, Language, and Multimodal Tasks. arXiv preprint arXiv:2305.17100. doi:10.48550/arXiv.2305.17100
  161. Zhao Z., Ma D., Chen L., Sun L., Li Z., Xia Y. (2024). Developing ChemDFM as a Large Language Foundation Model for Chemistry. arXiv preprint arXiv:2401.14818. doi:10.48550/arXiv.2401.14818
  162. Zhao J., Zhou Q., Wang T., Fan Y., Yang Q., Jiao L. (2025). MolProphecy: Bridging Medicinal Chemists’ Knowledge and Molecular Pre-trained Models via a Multi-Modal Framework. arXiv preprint arXiv:2507.02932. doi:10.48550/arXiv.2507.02932
  163. Zhavoronkov A., Ivanenkov Y. A., Aliper A., Veselov M. S., Aladinskiy V. A., Aladinskaia A. V. (2019). Deep learning enables rapid identification of potent ddr1 kinase inhibitors. Nat. Biotechnol. 37, 1038 – 1040. doi:10.1038/s41587-019-0224-x
  164. Zhou S.-F., Di Y. M., Chan E., Du -M., Chow V. D.-W., Xue C. C. (2008). Clinical pharmacogenomics. Clin. Pharmacol. and Ther. 9 (8), 738 – 748. doi:10.2174/138920008786049302
  165. Zhou Y., Wang F., Tang J., Nussinov R., Cheng F. (2020). Artificial intelligence in covid-19 drug repurposing. Lancet Digital Health 2, e667 – e676. doi:10.1016/S2589-7500(20)30192-8
  166. Zhou Z., Ji Y., Li W., Dutta P., Davuluri R., Liu H. (2023). Dnabert-2: Efficient Foundation Model and Benchmark for Multi-Species Genome. arXiv preprint arXiv:2306.15006. doi:10.48550/arXiv.2306.15006
  167. Zitnik M., Agrawal M., Leskovec J. (2018). Modeling polypharmacy side effects with graph convolutional networks. Bioinformatics 34, i457 – i466. doi:10.1093/bioinformatics/bty294

Citation

Hays, H. & Richardson, W. J. (2026). A survey of LLMs in drug discovery and precision medicine. Frontiers in Drug Discovery, Volume 6. https://doi.org/
Received
Accepted
Published
Volume
6 - 2026

Copyright

Copyright © 2026 Hays and Richardson.

License: https://creativecommons.org/licenses/by/4.0/

*Correspondence: Hasi Hays; William J. Richardson

Article metrics

Views
0
Downloads
0
Citations
0
Shares
0