AI ‘for all’: How access to new models is advancing academic research, from astronomy to education – Source – Microsoft

In early 2023, Professor Alice Oh and her colleagues at the Korea Advanced Institute of Science and Technology (KAIST) realized they needed to address the quickly growing interest in OpenAI ChatGPT among KAISTs students.

ChatGPT a tool developed by OpenAI that runs on large language models and generates conversational responses based on peoples prompts could lead to students taking shortcuts in their work but might also offer educational benefits, they reasoned. The group wanted to develop a research project that would engage students in using the technology, so they began thinking about how to develop their own chat application.

We were in a hurry, says Oh, a professor in the KAIST School of Computing. Our semester started in March, and we wanted to have students start using this right away when the semester started.

A solution soon emerged. In April 2023, Microsoft Research launched an initiative that aims to accelerate the development and use of foundation models large-scale AI models trained on vast amounts of data that can be used for a wide range of tasks.

Advancing Foundation Models Research (AFMR) provides academic researchers with access to state-of-the-art foundation models through Azure AI Services, with the goal of fostering a global AI research community and offering robust, trustworthy models that help further research in disciplines ranging from scientific discovery and education to healthcare, multicultural empowerment, legal work and design.

The initiatives grant program includes 200 projects at universities in 15 countries, spanning a broad range of focus areas. Researchers at Bostons Northeastern University are working on an AI-powered assistant designed to appear empathetic toward workers well-being. At Ho Chi Minh City University of Technology in Vietnam, researchers plan to create a fine-tuned large language model (LLM) specifically for Vietnamese. In Canada, researchers at the Universit de Montral are exploring how LLMs could help with molecular design and the discovery of new drugs.

Accessing foundation models can be challenging for academic researchers, who must often wait to use shared resources that can lack the computing power needed to run large models. Microsoft Research created the initiative to give researchers access to a range of powerful foundation models available through Azure and ensure that the development of AI is driven not just by industry, but also by the academic research community.

We realized that to develop AI today, there is really a need for industry to open up capacity for academia, says Evelyne Viegas, senior director of Research Catalyst at Microsoft Research. Those different viewpoints could shape what were doing.

With access to Azure OpenAI Service, which combines cutting-edge models from OpenAI with security, privacy and responsible AI protections offered in Azure, Oh and the KAIST team developed a platform that uses the models underlying ChatGPT for a chatbot to help college students write essays for English as a Foreign Language (EFL) courses. Students often write at night, when guidance from professors or teaching assistants isnt available, Oh says, and EFL students frequently use tools to help navigate the challenges of writing in English.

Ohs team designed the chatbot to answer students questions but not write their essays for them. Over a semester, 213 EFL students used the tool to refine their essays; the platform collected the students questions and essay revisions they made based on the chatbots responses, then Ohs team analyzed the data and published a paper about the experiment.

The researchers found that some students used the platform extensively and incorporated the feedback it provided. Many treated the chatbot like an intelligent peer, Oh says, suggesting that the technology can be a helpful complement to classroom instruction. And since the platform uses GPT-4, a large multimodal model developed by OpenAI that can communicate in multiple languages, students sometimes switched between English and their native language when using the platform, enabling more natural interactions.

The KAIST team plans to expand the platform to creative writing and conversational English classes. Oh sees tremendous potential for generative AI in education, particularly if models can be trained to show students how to reason through problems rather than simply providing answers.

Universities should take full advantage of this and really start to think about how we can use these tools for scientific research and education, she says.

Researchers at North Carolina Agricultural and Technical State University, who received a grant under the Microsoft program, are developing an AI-based traffic monitoring system capable of identifying road congestion and safety hazards. The project is aimed at automating much of the manual work required by traditional traffic monitoring systems.

The researchers used GPT-4 alongside other AI models that rely on traffic data collected by the federal government to analyze traffic patterns and congestion. Users interact with the system through a chatbot and can ask questions about current traffic conditions like how busy traffic is at a particular location or the speed at which vehicles are traveling.

It will make traffic management easier and more efficient, says Tewodros Gebre, a Ph.D. student working on the project.

The system uses GPT-4 to interpret traffic data collected from sensors, drones and GPS, allowing transportation agencies, city planners and citizens who arent necessarily data scientists to quickly get information about traffic conditions through the chat application.

We talk about data equity, and this combination with the chatbot makes the system available to people without them needing to go to this complex model and see whats going on, says Leila Hashemi-Beni, an associate professor in geospatial and remote sensing at the university. People with different skill sets can still get the information they need from this system.

The system, which is still in development, could also help identify the best evacuation routes after a natural disaster, she says.

Its not just transportation. This project has much bigger, broader impact. It gives us the opportunity for cutting-edge research that is very helpful to us as researchers and educators.

A collaboration between astronomers at Harvard University and The Australian National University is leveraging GPT-4 in a different way. Seeking to use LLMs to accelerate astronomy research, the group, called UniverseTBD, developed an astronomy-based chat application that draws from more than 300,000 astronomy papers.

Alyssa Goodman, the Robert Wheeler Wilson Professor of Applied Astronomy at Harvard, says the application could eventually help young astronomers extract key information from academic papers and analyze data to develop their own research and theories.

If you have a really good idea, its very hard to just search the literature and try to find everything, Goodman says. This is sort of like having a super adviser, a brilliant astronomer with an encyclopedic memory who can say, Well, that could be a very good idea and heres why, or Thats likely a bad idea and heres why.

The researchers hope to develop smaller language models for astronomy that will be accessible to astronomers of all levels, says Ioana Ciuc, the Jubilee Joint Fellow at The Australian National University leading UniverseTBD with Sandor Kruk, a data scientist at the European Space Agency, and Kartheik Iyer, a NASA Hubble Fellow at Columbia University.

Our mission is to democratize science for everyone, she says. GPT-4 is a very large language model and it runs on a lot of resources. In our pursuit of democratizing access, we want to build smaller models that learn from GPT-4 and can also learn to speak the language of astronomy better than GPT-4. Thats what were envisioning.

Many of the AFMR research projects focus on using LLMs for a range of societal benefits, from leveraging generative AI to assess pandemic risk to using vision and language models to help people who are blind or have low vision navigate outdoors.

See the rest here:

AI 'for all': How access to new models is advancing academic research, from astronomy to education - Source - Microsoft