ChatGPT Gets B|B- Grade On Wharton MBA Exam

Following up on this morning's post, ChatGPT Gets C+ Grade On Four Minnesota Law School Exams:  Christian Terwiesch (Wharton; Google Scholar), Would Chat GPT3 Get a Wharton MBA?:

OpenAI’s Chat GPT3 has shown a remarkable ability to automate some of the skills of highly compensated knowledge workers in general and specifically the knowledge workers in the jobs held by MBA graduates including analysts, managers, and consultants. Chat GPT3 has demonstrated the capability of performing professional tasks such as writing software code and preparing legal documents. The purpose of this paper is to document how Chat GPT3 performed on the final exam of a typical MBA core course, Operations Management. Exam questions were uploaded as used in a final exam setting and then graded.

The “academic performance” of Chat GPT3 can be summarized as follows. First, it does an amazing job at basic operations management and process analysis questions including those that are based on case studies. Not only are the answers correct, but the explanations are excellent. Second, Chat GPT3 at times makes surprising mistakes in relatively simple calculations at the level of 6th grade Math. These mistakes can be massive in magnitude. Third, the present version of Chat GPT is not capable of handling more advanced process analysis questions, even when they are based on fairly standard templates. This includes process flows with multiple products and problems with stochastic effects such as demand variability. Finally, ChatGPT3 is remarkably good at modifying its answers in response to human hints. In other words, in the instances where it initially failed to match the problem with the right solution method, Chat GPT3 was able to correct itself after receiving an appropriate hint from a human expert.

Considering this performance, Chat GPT3 would have received a B to B- grade on the exam. This has important implications for business school education, including the need for exam policies, curriculum design focusing on collaboration between human and AI, opportunities to simulate real world decision making processes, the need to teach creative problem solving, improved teaching productivity, and more.

• Financial Times, AI Chatbot’s MBA Exam Pass Poses Test For Business Schools
• New York Post, AI Bot ChatGPT Outperforms Students on Wharton MBA Exam: Professor

Prior TaxProf Blog coverage:

• A Human Being Wrote This Law Review Article: GPT-3 And The Practice Of Law (May 11, 2022)
• The Implications Of OpenAI’s Assistant For Legal Services And Society (Dec. 7, 2022)
• ChatGPT And Law School Exams (Dec. 29, 2022)
• GPT Will Soon Be Able To Pass The Multistate Bar Exam (Jan. 5, 2023)
• Using ChatGPT To Write Law School Exams, Bar Exams, And Strategic Plans (Jan. 11, 2023)
• ChatGPT Gets B|B- Grade On Wharton MBA Exam (Jan. 24, 2023)
• ChatGPT Gets C+ Grade On Four Minnesota Law School Exams (C- In Tax) (Jan. 24, 2023)
• The Rise Of The Robotic Tax Analyst (Jan. 27, 2023)
• Ryznar: Exams In The Time Of ChatGPT (Feb. 1, 2023)
• Bishop Posts Two Papers On ChatGPT (Feb. 8, 2023)
• ChatGPT Almost Passed The Bar, But Competent Lawyers Do Much More (Feb. 23, 2023)
• It’s Not Just Our Students: ChatGPT Is Coming For Faculty Scholarship (Feb. 25, 2023)
• New AI Detector Is 97% Effective In Catching Students Cheating With ChatGPT (Feb. 28, 2023)
• It’s Not Just Our Students: ChatGPT Is Coming For Faculty Scholarship (Feb. 25, 2023)
• ChatGPT's Tax Advice Was Wrong 100% Of The Time (Mar. 7, 2023)
• Does ChatGPT Produce Fishy Briefs? (Mar. 8, 2023)
• Colleges (And Law Schools) Are Rushing To Respond To ChatGPT (Mar. 9, 2023)
• Was The Sermon You Heard At Church Today Written By ChatGPT? (Mar. 12, 2023)
• GPT-4 Beats 90% Of Aspiring Lawyers On The Bar Exam (Mar. 17, 2023)
• ChatGPT Thinks I Am Way More Interesting Than I Am (Mar. 22, 2023)
• Should ChatGPT Be In Law School? (Mar. 30, 2023)
• Merritt: GPT-4 On Legal Education And Lawyer Licensing (Apr. 4, 2023)
• Turnitin Plagiarism Detector Will Catch Students Who Cheat With ChatGPT With 98% Accuracy (Apr. 5, 2023)
• ChatGPT Gets 148 (37th Percentile) And 157 (70th Percentile) On The LSAT (Apr. 6, 2023)
• AI Tools for Lawyers: A Practical Guide (Apr. 6, 2023)