The development, based on artificial intelligence, will make it possible to improve breast cancer treatments and warn of wrong diagnoses
Computational models developed by researchers at the Taub Faculty of Computer Science will make it possible to better evaluate the effectiveness of immunotherapy treatments, to predict the patient’s life expectancy, to improve the treatments in a personalized way and to warn of wrong diagnoses. The research on the subject is led by Dr. Gil Shamai, post- PhD student in the Laboratory for Geometric Image Processing (GIP) led by Prof. Ron Kimmel. Prof. Kimmel is a faculty member in the Taub Faculty of Computer Science and a professor with a secondary affiliation in the Viterbi Faculty of Electrical and Computer Engineering.
The article that has just been published in the prestigious journal Nature Communications Describes a method based on technology and experiments developed by Dr. Shamai with Amir Livna, a master’s degree graduate from the laboratory, for the purpose of better evaluating the effectiveness of immunotherapy treatment in breast cancer. The researchers worked closely with Prof. Edmond Sabo, director of the Institute of Pathology at Carmel Hospital; Dr. R. Alexandra Kerzo, a pathology specialist at the Carmel Hospital; and Dr. Antonio Polonia from the Ipatimup Pathology Laboratory in Portugal; with the support of Prof. Gil Bar Sela, the director of the oncology department at the Emek Hospital.
Breast cancer has become the leading cause of death among women aged 20-59 and the most diagnosed cancer in 2021, with approximately 12% of all diagnoses worldwide. The incidence of breast cancer in the population is increasing due to population growth, environmental pollution, industrialized nutrition, climate change and more. The immune system is able, in many cases, to eliminate cancer cells in a targeted and more effective way than drug therapy. The problem is that the cancer cells, which also developed in a long evolution, may develop mechanisms that prevent the immune system from attacking them. One of the innovative and experimental methods for treating breast cancer, in light of the success in treating other types of cancer, is immunotherapy – an approach that helps the immune system attack the cancer cells by damaging these mechanisms.
One of the common immunotherapy treatments is based on the interaction of a protein called PD-L1 with immune system cells. The interaction inhibits the immune system from working, and immunotherapy may prevent this interaction and thus help the immune system attack the tumor. However, the treatment is effective and approved for use only when PD-L1 proteins are expressed in the cancer cells themselves. Against this background, the need arose to differentiate between tumors characterized by the presence of the PD-L1 protein, in which immunotherapy is expected to help, and tumors that are not. The problem is that measuring PD-L1 is not a simple task, and current measurement methods are expensive and imprecise.
“Unfortunately, I personally experienced the problematic nature of the existing methods during my father’s anti-cancer treatments,” says Prof. Kimmel. “These are inconsistent methods, that is – different measurements of the same phenomenon give different results. In addition, they are very expensive and not available everywhere, and the result is that the treatments are still given in a process that involves a lot of trial and error, meaning a huge waste of time and money and of course unnecessary suffering.”
The research group developed following a request from an intern (in medicine) who heard about the wonders of artificial intelligence and turned to Prof. Kimmel and Dr. Shamai with the question: Can artificial intelligence help in the analysis of samples (biopsy) from breast cancer for the purpose of measuring the expression of receptors and proteins? “His proposal resonated with me. Very interesting and I started researching the subject,” says Dr. Shamai. “I went to expert pathologists and they explained to me that the resolution of the tissue diagnosis is not sufficient to see receptors and proteins without special molecular stainings. One of them even said that it is like looking at a closed door and guessing what is in the room. This project became my research in the following years, because I wanted to prove to them that they are wrong.” The research group was established a few years ago and currently employs a large group of engineers, clinicians and undergraduate, graduate and postgraduate students.
“Pathologists we spoke with said that this is an impossible task,” explains Prof. Kimmel, “because a human pathologist cannot deduce the properties of a tumor from its shape due to the huge amount of variables. The good news is that artificial intelligence technologies and especially deep learning are able to do this. The computer, unlike A pathologist, and even the most skilled pathologist, can characterize the cancer with a complex analysis of its morphology.”
The first breakthrough in research occurred about three years ago and was presented in an article in the journal JAMA in which the group presented success in identifying receptors on cancer cells. The technology presented by the researchers is based on deep learning. It extracts molecular information from biopsy images that have undergone hematoxylin and eosin (H&E) staining – a common staining used to examine tissue taken in a biopsy. The staining allows the pathologist to identify in the tissue, under the microscope, the type of cancer and its degree of severity. However, the staining alone does not allow identifying proteins that are essential in determining the appropriate treatment. This is the challenge that the Technion researchers had to face.
Now, three years after the JAMA article, the researchers present success in measuring PD-L1 protein expression on a large sample pool: biopsies from more than 3,000 breast cancer patients. According to Dr. Shamai and Prof. Kimmel, “Deep learning requires a huge amount of information, and obtaining the required type of information is not easy. For this purpose, we wrote software code to scan online sources and automatically download thousands of biopsy samples and the relevant medical information approved for research use. The help of the pathologists who signed the study was very essential.”
The computational model developed by the researchers does not “see the receptors and proteins” directly but knows how to infer their presence or absence based on the morphology of the tissue, or the “signature” that the cancer leaves in the tissue, as reflected in H&E scans. “This is such a complex relationship,” says Dr. Shamai, “that the algorithm we developed knows how to provide us with the necessary information, but we don’t really understand how it does it.”
The research is based on advanced technologies of geometric processing of images – one of the research focuses in Prof. Ron Kimmel’s laboratory, in which Dr. Shamai’s group operates. “It is a huge and complex challenge – producing a reliable and accurate clinical image based on partial information,” says Prof. Kimmel. “There are a lot of factors involved here – engineers, clinicians, students and ten hospitals in Israel and abroad. The research group was required to study the clinical aspects of breast cancer and its diagnosis and create a huge database and tools for analyzing the data and creating a reliable prediction. Gil also had an administrative task here petition, and he met it with impressive success, among other things by obtaining seven research grants from foundations that recognized the importance of the project. In fact, he established a kind of medical-technological startup here that presents dramatic achievements in the field of cancer.”
The new technology has been verified (validated) on data from 300 breast cancer patients from a clinical trial. The researchers estimate that this approach, the analysis of pathological images using artificial intelligence, will become a significant factor in cancer research, in improving diagnosis and in improving the suitability of treatment for the patient.
The research was supported by the Innovation Authority (Kamin grant) and by the National Science Foundation (the research program in personalized medicine).
for the article in the journalNature Communications click here
More on the subject on the science website: