{"id":13734,"date":"2023-12-26T06:00:00","date_gmt":"2023-12-26T00:30:00","guid":{"rendered":"https:\/\/cbirt.net\/staging\/?p=13734"},"modified":"2026-10-22T15:29:23","modified_gmt":"2026-10-22T09:59:23","slug":"how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers","status":"publish","type":"post","link":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/","title":{"rendered":"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers"},"content":{"rendered":"\n<p class=\"has-text-align-justify has-background wp-block-paragraph\" style=\"background-color:#f7f8f9\"><em>Artificial intelligence is transforming industries across the board, and the life sciences are no exception. A new study led by researchers at Anthropic, an AI safety startup based in San Francisco, published in&nbsp;Nature Biotechnology, demonstrates the immense potential of large language models (LLMs) like ChatGPT to serve as AI assistants for bioinformatics research. The paper presents<strong>&nbsp;BioLLMBench, a comprehensive framework for evaluating how well LLMs can perform daily bioinformatics tasks.&nbsp;<\/strong>The results reveal both great promise and current limitations, underscoring the need for responsible development of AI in this complex domain.<\/em><\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">As LLMs like <a href=\"https:\/\/cbirt.net\/staging\/large-language-models-offering-solutions-to-tackle-biological-complexity\/\" target=\"_blank\" rel=\"noreferrer noopener\">ChatGPT<\/a>, Anthropic&#8217;s Claude, and Google&#8217;s Bard gain popularity, there are high hopes for their utility in scientific fields. However, their actual capabilities in specialized domains like bioinformatics still need to be proven. This research tackles that knowledge gap through an extensive benchmarking effort. With life sciences poised to be disrupted by AI, empirical insight into the strengths and weaknesses of LLMs is invaluable for researchers anticipating their integration into real-world workflows.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-benchmarking-framework-evaluates-performance-across-bioinformatics-tasks\">Benchmarking Framework Evaluates Performance Across Bioinformatics Tasks<\/h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">To thoroughly test LLMs, the researchers designed BioLLMBench to evaluate performance on 36 representative tasks across six key areas:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Core domain knowledge<\/li>\n\n\n\n<li>Data visualization<\/li>\n\n\n\n<li>Coding<\/li>\n\n\n\n<li>Mathematical problem solving<\/li>\n\n\n\n<li>Summarizing research papers<\/li>\n\n\n\n<li>Developing machine learning models<\/li>\n<\/ul>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">These tasks aim to mimic the daily challenges faced by bioinformaticians. The benchmark also includes questions ranging from basic concepts to expert-level complexity.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Using this framework, the study tested three leading LLMs &#8211; Anthropic&#8217;s Claude, Google&#8217;s Bard, and Anthropic&#8217;s LLaMA &#8211; by conducting over 2000 experimental runs. Each model&#8217;s response was scored using customized metrics tailored to each task type. For example, domain knowledge answers were judged on accuracy, clarity, and relevance, while coding tasks were assessed on style, correctness, and error handling.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-key-results-llms-show-promise-alongside-limitations\">Key Results &#8211; LLMs Show Promise Alongside Limitations<\/h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">The results reveal a mixed picture of LLMs&#8217; readiness to assist bioinformatics research. On straightforward tasks like defining terms and differentiating concepts, all the models achieved high scores, indicating a strong grasp of core biology and genomics knowledge. However, performance varied widely across more complex tasks.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">In coding challenges, Claude consistently produced executable scripts and helpful code comments, outperforming LLaMA and Bard. For data visualization, Claude again led, providing complete Python code to generate plots. However, LLaMA and Bard could only describe the steps textually. Bard edged out Claude at mathematical problem solving, while Claude generated more robust machine learning pipelines with sufficient prompting and debugging.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">However, major shortcomings emerged. All models struggled to summarize key insights from research papers &#8211; reading and understanding research papers is an essential task for bioinformatics researchers. The best ROUGE scores were only around 40%, indicating poor capture of key details and rhetorical structures. The models also required heavy guidance to produce complete machine-learning code, including fixing errors and providing missing steps.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">These results confirm that while LLMs have great potential to automate routine bioinformatics tasks, they cannot yet match human judgment for higher-order challenges like summarization and analysis. Their assistance potential strongly depends on the user&#8217;s domain expertise to interpret and validate outputs.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-contextual-analysis-reveals-insights-on-optimizing-llm-usage\">Contextual Analysis Reveals Insights on Optimizing LLM Usage<\/h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Beyond tasks, the study also tested how using LLMs in different contextual chat environments impacted performance. They compared scores when posing all questions to models within one consistent chat window versus opening new windows for each query.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">While average scores were similar, new chat windows increased variability &#8211; sometimes producing better responses but also inferior ones compared to sticking with one window. Maintaining chat context appears to make model outputs more stable and predictable.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">These findings suggest that bioinformatics newcomers may benefit from a consistent window, while experts can try new windows to spur potential creativity from models while being able to validate unusual outputs.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-current-limitations-and-ethical-considerations\">Current Limitations and Ethical Considerations<\/h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">Despite their promise, responsible LLM integration in bioinformatics requires acknowledging limitations around biases, privacy, interpretability, and potential misinformation. The researchers emphasize that LLMs should not be viewed as omniscient experts. Users must critically evaluate outputs, especially for higher-order tasks.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">They also caution that LLMs need more understanding of complex bioinformatics workflows. Erroneous or oversimplified outputs could mislead non-experts. Users should be transparent about an LLM&#8217;s involvement in any work.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-looking-ahead-guiding-responsible-llm-adoption-in-bioinformatics\">Looking Ahead &#8211; Guiding Responsible LLM Adoption in Bioinformatics<\/h2>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">By empirically demonstrating what LLMs can and cannot currently achieve in bioinformatics, this study provides crucial insights for managing expectations and directing further development. While not yet a silver bullet, LLMs have clear potential to accelerate and enhance bioinformatics research when thoughtfully implemented.<\/p>\n\n\n\n<p class=\"has-text-align-justify wp-block-paragraph\">The way forward requires addressing current limitations, expanding rigorous benchmarking to additional models and tasks, and establishing best practices for transparent and ethical LLM integration into real-world applications. With proper guidance and oversight, AI promises to unlock new discoveries that improve human <a href=\"https:\/\/cbirt.net\/staging\/mit-researchers-used-large-language-models-to-decode-clinical-health-records-in-few-shots\/\" target=\"_blank\" rel=\"noreferrer noopener\">health<\/a> and scientific understanding.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Story Source: <a href=\"https:\/\/doi.org\/10.1101\/2023.12.19.572483;\" target=\"_blank\" rel=\"noreferrer noopener\">Reference Paper<\/a><\/p>\n\n\n\n<p class=\"has-text-align-left has-background wp-block-paragraph\" style=\"background-color:#ebf7ff\"><strong><em>Important Note:<\/em><\/strong> <em>bioRxiv<\/em> releases preprints that have not yet undergone peer review. As a result, it is important to note that these papers should not be considered conclusive evidence, nor should they be used to direct clinical practice or influence health-related behavior. It is also important to understand that the information presented in these papers is not yet considered established or confirmed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\" style=\"font-size:18px\"><strong><em><mark style=\"background-color: #ffffff;\" class=\"has-inline-color has-black-color\">Learn More:<\/mark><\/em><\/strong><\/p>\n\n\n\n<style>\n* {\n  box-sizing: border-box;\n}\n\n.column {\n  float: left;\n  width: 33.33%;\n  padding: 5px;\n}\n\n\/* Clearfix (clear floats) *\/\n.row::after {\n  content: \"\";\n  clear: both;\n  display: table;\n}\n<\/style>\n\n\n\n<div class=\"row\">\n  <div class=\"column\">\n    <a href=\"https:\/\/cbirt.net\/staging\/bioinformatics-books\/\" target=\"_blank\" rel=\"noopener\">\n      <img decoding=\"async\" src=\"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/02\/Bioinformatics-Books-1.webp\" alt=\"Bioinformatics Books\">\n    <\/a>\n  <\/div>\n  <div class=\"column\">\n    <a href=\"https:\/\/cbirt.net\/staging\/bioinformatics-online-courses\/\" target=\"_blank\" rel=\"noopener\">\n        <img decoding=\"async\" src=\"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/02\/Online-Courses-1.webp\" alt=\"Bioinformatics Online Courses\">\n    <\/a>\n  <\/div>\n  <div class=\"column\">\n    <a href=\"https:\/\/cbirt.net\/staging\/category\/bioinformatics-news\/\" target=\"_blank\" rel=\"noopener\">\n        <img decoding=\"async\" src=\"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/02\/Bioinformatics-News.webp\" alt=\"Bioinformatics News CBIRT\">\n    <\/a>\n  <\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Artificial intelligence is transforming industries across the board, and the life sciences are no exception. A new study led by researchers at Anthropic, an AI safety startup based in San Francisco, published in&nbsp;Nature Biotechnology, demonstrates the immense potential of large language models (LLMs) like ChatGPT to serve as AI assistants for bioinformatics research. The paper&#8230;<\/p>\n","protected":false},"author":3,"featured_media":13741,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_kad_post_transparent":"","_kad_post_title":"","_kad_post_layout":"","_kad_post_sidebar_id":"","_kad_post_content_style":"","_kad_post_vertical_padding":"","_kad_post_feature":"","_kad_post_feature_position":"","_kad_post_header":false,"_kad_post_footer":false,"_kad_post_classname":"","footnotes":""},"categories":[149,1147,154,4406,140,134],"tags":[198,2688,2689,2886],"class_list":["post-13734","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","category-big-data","category-bioinformatics","category-llm","category-bioinformatics-news","category-trending","tag-artificial-intelligence","tag-large-language-models","tag-llms","tag-llms-in-biology"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v28.7 (Yoast SEO v28.7) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers - CBIRT<\/title>\n<meta name=\"description\" content=\"BioLLMBench is a comprehensive framework for evaluating how well LLMs can perform daily bioinformatics tasks.\" \/>\n<meta name=\"robots\" content=\"noindex, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers\" \/>\n<meta property=\"og:description\" content=\"BioLLMBench is a comprehensive framework for evaluating how well LLMs can perform daily bioinformatics tasks.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/\" \/>\n<meta property=\"og:site_name\" content=\"CBIRT\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Centre.Bioinformatics.Research.Technology\" \/>\n<meta property=\"article:published_time\" content=\"2023-12-26T00:30:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-10-22T09:59:23+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/12\/BioLLMBench-1.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1256\" \/>\n\t<meta property=\"og:image:height\" content=\"942\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Dr. Tamanna Anwar\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@CbirtDirector\" \/>\n<meta name=\"twitter:site\" content=\"@CbirtDirector\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Dr. Tamanna Anwar\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/\"},\"author\":{\"name\":\"Dr. Tamanna Anwar\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#\\\/schema\\\/person\\\/80a42faa996bcd1d84a7ed35e7c2ff12\"},\"headline\":\"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers\",\"datePublished\":\"2023-12-26T00:30:00+00:00\",\"dateModified\":\"2026-10-22T09:59:23+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/\"},\"wordCount\":881,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/BioLLMBench-1.webp\",\"keywords\":[\"Artificial Intelligence\",\"Large Language Models\",\"LLMs\",\"LLMs in Biology\"],\"articleSection\":[\"AI\",\"Big Data\",\"Bioinformatics\",\"LLM\",\"News\",\"Trending\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/\",\"url\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/\",\"name\":\"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers - CBIRT\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/BioLLMBench-1.webp\",\"datePublished\":\"2023-12-26T00:30:00+00:00\",\"dateModified\":\"2026-10-22T09:59:23+00:00\",\"description\":\"BioLLMBench is a comprehensive framework for evaluating how well LLMs can perform daily bioinformatics tasks.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/BioLLMBench-1.webp\",\"contentUrl\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/wp-content\\\/uploads\\\/2023\\\/12\\\/BioLLMBench-1.webp\",\"width\":1256,\"height\":942,\"caption\":\"Image Credit: Team CBIRT\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#website\",\"url\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/\",\"name\":\"CBIRT\",\"description\":\"Centre of Bioinformatics Research &amp; Technology\",\"publisher\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#organization\",\"name\":\"Centre of Bioinformatics Research & Technology\",\"alternateName\":\"CBIRT\",\"url\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/CBIRT-Logo-Transparent.png\",\"contentUrl\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/wp-content\\\/uploads\\\/2026\\\/09\\\/CBIRT-Logo-Transparent.png\",\"width\":403,\"height\":403,\"caption\":\"Centre of Bioinformatics Research & Technology\"},\"image\":{\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/Centre.Bioinformatics.Research.Technology\",\"https:\\\/\\\/x.com\\\/CbirtDirector\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/cbirt\\\/\",\"https:\\\/\\\/www.instagram.com\\\/cbirtdirector\\\/\",\"https:\\\/\\\/www.reddit.com\\\/user\\\/cbirt_\"],\"description\":\"Centre of Bioinformatics Research & Technology (CBIRT) is an ISO 9001:2015 certified, MSME-registered bioinformatics training and research organization based in India. CBIRT provides hands-on training programs in computational biology and bioinformatics \u2014 including genomics, network biology, drug discovery, and cancer data analysis \u2014 alongside OMICS data analysis services and science communication for the global bioinformatics community.\",\"email\":\"info@cbirt.net\",\"telephone\":\"+91-6398142849\",\"legalName\":\"Centre of Bioinformatics Research and Technology\",\"numberOfEmployees\":{\"@type\":\"QuantitativeValue\",\"minValue\":\"1\",\"maxValue\":\"10\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/cbirt.net\\\/staging\\\/#\\\/schema\\\/person\\\/80a42faa996bcd1d84a7ed35e7c2ff12\",\"name\":\"Dr. Tamanna Anwar\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5d2f8d79c151b5b9e5965d78b9246f1e558351590219594e7068849ac381ca97?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5d2f8d79c151b5b9e5965d78b9246f1e558351590219594e7068849ac381ca97?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5d2f8d79c151b5b9e5965d78b9246f1e558351590219594e7068849ac381ca97?s=96&d=mm&r=g\",\"caption\":\"Dr. Tamanna Anwar\"},\"description\":\"Dr. Tamanna Anwar is a Scientist and Co-founder of the Centre of Bioinformatics Research and Technology (CBIRT). She is a passionate bioinformatics scientist and a visionary entrepreneur. Dr. Tamanna has worked as a Young Scientist at Jawaharlal Nehru University, New Delhi. She has also worked as a Postdoctoral Fellow at the University of Saskatchewan, Canada. She has several scientific research publications in high-impact research journals. Her latest endeavor is the development of a platform that acts as a one-stop solution for all bioinformatics related information as well as developing a bioinformatics news portal to report cutting-edge bioinformatics breakthroughs.\",\"sameAs\":[\"https:\\\/\\\/cbirt.net\\\/staging\"],\"honorificPrefix\":\"Dr.\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers - CBIRT","description":"BioLLMBench is a comprehensive framework for evaluating how well LLMs can perform daily bioinformatics tasks.","robots":{"index":"noindex","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers","og_description":"BioLLMBench is a comprehensive framework for evaluating how well LLMs can perform daily bioinformatics tasks.","og_url":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/","og_site_name":"CBIRT","article_publisher":"https:\/\/www.facebook.com\/Centre.Bioinformatics.Research.Technology","article_published_time":"2023-12-26T00:30:00+00:00","article_modified_time":"2026-10-22T09:59:23+00:00","og_image":[{"width":1256,"height":942,"url":"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/12\/BioLLMBench-1.webp","type":"image\/webp"}],"author":"Dr. Tamanna Anwar","twitter_card":"summary_large_image","twitter_creator":"@CbirtDirector","twitter_site":"@CbirtDirector","twitter_misc":{"Written by":"Dr. Tamanna Anwar","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#article","isPartOf":{"@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/"},"author":{"name":"Dr. Tamanna Anwar","@id":"https:\/\/cbirt.net\/staging\/#\/schema\/person\/80a42faa996bcd1d84a7ed35e7c2ff12"},"headline":"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers","datePublished":"2023-12-26T00:30:00+00:00","dateModified":"2026-10-22T09:59:23+00:00","mainEntityOfPage":{"@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/"},"wordCount":881,"commentCount":0,"publisher":{"@id":"https:\/\/cbirt.net\/staging\/#organization"},"image":{"@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#primaryimage"},"thumbnailUrl":"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/12\/BioLLMBench-1.webp","keywords":["Artificial Intelligence","Large Language Models","LLMs","LLMs in Biology"],"articleSection":["AI","Big Data","Bioinformatics","LLM","News","Trending"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/","url":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/","name":"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers - CBIRT","isPartOf":{"@id":"https:\/\/cbirt.net\/staging\/#website"},"primaryImageOfPage":{"@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#primaryimage"},"image":{"@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#primaryimage"},"thumbnailUrl":"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/12\/BioLLMBench-1.webp","datePublished":"2023-12-26T00:30:00+00:00","dateModified":"2026-10-22T09:59:23+00:00","description":"BioLLMBench is a comprehensive framework for evaluating how well LLMs can perform daily bioinformatics tasks.","breadcrumb":{"@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#primaryimage","url":"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/12\/BioLLMBench-1.webp","contentUrl":"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2023\/12\/BioLLMBench-1.webp","width":1256,"height":942,"caption":"Image Credit: Team CBIRT"},{"@type":"BreadcrumbList","@id":"https:\/\/cbirt.net\/staging\/how-well-can-llms-really-perform-bioinformatics-tasks-biollmbench-has-answers\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cbirt.net\/staging\/"},{"@type":"ListItem","position":2,"name":"How Well Can LLMs Really Perform Bioinformatics Tasks? BioLLMBench Has Answers"}]},{"@type":"WebSite","@id":"https:\/\/cbirt.net\/staging\/#website","url":"https:\/\/cbirt.net\/staging\/","name":"CBIRT","description":"Centre of Bioinformatics Research &amp; Technology","publisher":{"@id":"https:\/\/cbirt.net\/staging\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cbirt.net\/staging\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/cbirt.net\/staging\/#organization","name":"Centre of Bioinformatics Research & Technology","alternateName":"CBIRT","url":"https:\/\/cbirt.net\/staging\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/cbirt.net\/staging\/#\/schema\/logo\/image\/","url":"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2026\/09\/CBIRT-Logo-Transparent.png","contentUrl":"https:\/\/cbirt.net\/staging\/wp-content\/uploads\/2026\/09\/CBIRT-Logo-Transparent.png","width":403,"height":403,"caption":"Centre of Bioinformatics Research & Technology"},"image":{"@id":"https:\/\/cbirt.net\/staging\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Centre.Bioinformatics.Research.Technology","https:\/\/x.com\/CbirtDirector","https:\/\/www.linkedin.com\/in\/cbirt\/","https:\/\/www.instagram.com\/cbirtdirector\/","https:\/\/www.reddit.com\/user\/cbirt_"],"description":"Centre of Bioinformatics Research & Technology (CBIRT) is an ISO 9001:2015 certified, MSME-registered bioinformatics training and research organization based in India. CBIRT provides hands-on training programs in computational biology and bioinformatics \u2014 including genomics, network biology, drug discovery, and cancer data analysis \u2014 alongside OMICS data analysis services and science communication for the global bioinformatics community.","email":"info@cbirt.net","telephone":"+91-6398142849","legalName":"Centre of Bioinformatics Research and Technology","numberOfEmployees":{"@type":"QuantitativeValue","minValue":"1","maxValue":"10"}},{"@type":"Person","@id":"https:\/\/cbirt.net\/staging\/#\/schema\/person\/80a42faa996bcd1d84a7ed35e7c2ff12","name":"Dr. Tamanna Anwar","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/5d2f8d79c151b5b9e5965d78b9246f1e558351590219594e7068849ac381ca97?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/5d2f8d79c151b5b9e5965d78b9246f1e558351590219594e7068849ac381ca97?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5d2f8d79c151b5b9e5965d78b9246f1e558351590219594e7068849ac381ca97?s=96&d=mm&r=g","caption":"Dr. Tamanna Anwar"},"description":"Dr. Tamanna Anwar is a Scientist and Co-founder of the Centre of Bioinformatics Research and Technology (CBIRT). She is a passionate bioinformatics scientist and a visionary entrepreneur. Dr. Tamanna has worked as a Young Scientist at Jawaharlal Nehru University, New Delhi. She has also worked as a Postdoctoral Fellow at the University of Saskatchewan, Canada. She has several scientific research publications in high-impact research journals. Her latest endeavor is the development of a platform that acts as a one-stop solution for all bioinformatics related information as well as developing a bioinformatics news portal to report cutting-edge bioinformatics breakthroughs.","sameAs":["https:\/\/cbirt.net\/staging"],"honorificPrefix":"Dr."}]}},"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/posts\/13734","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/comments?post=13734"}],"version-history":[{"count":1,"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/posts\/13734\/revisions"}],"predecessor-version":[{"id":20046,"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/posts\/13734\/revisions\/20046"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/media\/13741"}],"wp:attachment":[{"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/media?parent=13734"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/categories?post=13734"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cbirt.net\/staging\/wp-json\/wp\/v2\/tags?post=13734"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}