Skip to main content

ChatGPT (barely) passed graduate business and law exams

By

There's plenty of concern that OpenAI's ChatGPT could help students cheat on tests, but just how well would the chatbot fare if you asked it to write a graduate-level exam? It would pass — if only just. In a newly published study, University of Minnesota law professors had ChatGPT produce answers for graduate exams at four courses in their school. The AI passed all four, but with an average grade of C+. In another recent paper, Wharton School of Business professor Christian Terwiesch found that ChatGPT passed a business management exam with a B to B- grade. You wouldn't want to use the technology to impress academics, then.

The research teams found the AI to be inconsistent, to put it mildly. The University of Minnesota group noted that ChatGPT was good at addressing "basic legal rules" and summarizing doctrines, but floundered when trying to pinpoint issues relevant to a case. Terwiesch said the generator was "amazing" with simple operations management and process analysis questions, but couldn't handle advanced process questions. It even made mistakes with 6th grade-level math.

There's room for improvement. The Minnesota professors said they didn't adapt text generation prompts to specific courses or questions, and believed students could get better results with customization. At Wharton, Terwiesch said the bot was adept at changing answers in response to human coaching. ChatGPT might not ace an exam or essay by itself, but a cheater could have the system generate rough answers and refine them.

Both camps warned that schools should limit the use of technology to prevent ChatGPT-based cheating. They also recommended altering the questions to either discourage AI use (such as focusing on analysis rather than reciting rules) or increase the challenge for those people leaning on AI. Students still need to learn "fundamental skills" rather than leaning on a bot for help, the University of Minnesota said.

The study groups still believed that ChatGPT could have a place in the classroom. Professors could teach pupils how to rely on AI in the workplace, or even use it to write and grade exams. The tech could ultimately save time that could be spent on the students, Terwiesch explains, such as more student meetings and new course material.



from Engadget is a web magazine with obsessive daily coverage of everything new in gadgets and consumer electronics https://ift.tt/JLEcdZK
via IFTTT
Labels:

Comments

Post a Comment

Popular posts from this blog

Instagram accidentally reinstated Pornhub’s banned account

By
After years of on-and-off temporary suspensions, Instagram permanently banned Pornhub’s account in September. Then, for a short period of time this weekend, the account was reinstated. By Tuesday, it was permanently banned again. “This was done in error,” an Instagram spokesperson told TechCrunch. “As we’ve said previously, we permanently disabled this Instagram account for repeatedly violating our policies.” Instagram’s content guidelines prohibit  nudity and sexual solicitation . A Pornhub spokesperson told TechCrunch, though, that they believe the adult streaming platform’s account did not violate any guidelines. Instagram has not commented on the exact reasoning for the ban, or which policies the account violated. It’s worrying from a moderation perspective if a permanently banned Instagram account can accidentally get switched back on. Pornhub told TechCrunch that its account even received a notice from Instagram, stating that its ban had been a mistake (that message itse...
Post a Comment
Read more

California Gov. Newsom vetoes bill SB 1047 that aims to prevent AI disasters

By
California Gov. Gavin Newsom has vetoed bill SB 1047, which aims to prevent bad actors from using AI to cause "critical harm" to humans. The California state assembly passed the legislation by a margin of 41-9 on August 28, but several organizations including the Chamber of Commerce had urged Newsom to veto the bill . In his veto message on Sept. 29, Newsom said the bill is "well-intentioned" but "does not take into account whether an Al system is deployed in high-risk environments, involves critical decision-making or the use of sensitive data. Instead, the bill applies stringent standards to even the most basic functions - so long as a large system deploys it."  SB 1047 would have made the developers of AI models liable for adopting safety protocols that would stop catastrophic uses of their technology. That includes preventive measures such as testing and outside risk assessment, as well as an "emergency stop" that would completely shut down...
Post a Comment
Read more

If only your bike had a trunk. Oh wait, now it does.

By
Just to let you know, if you buy something featured here, Mashable might earn an affiliate commission. Biking is one of the best ways to get around, especially if you live in a city. It's quick, it's eco-friendly, and you get a bit of exercise.  If you already commute on two wheels or are thinking of starting, there's a storage device you kinda need. SEE ALSO: This bamboo keyboard combo adds a touch of tranquility to your workspace The Buca Boot is a pretty magical two-in-one hybrid: It’s a super secure storage box for your bike that works like the trunk of a car. You can lock your helmet or whatever else in it and leave it safely behind. It’s also a basket—open it up, and you can carry a bouquet of flowers and a baguette like the picturesque cyclist of your dreams.    Read more... More about Storage , Car , Bicycle , Trunk , and Cyclist from Mashable http://ift.tt/2eHNwLB via IFTTT
Post a Comment
Read more