New AI and the Law course explores the capacity and limits of technology in the legal profession

A Q&A with student Ja’Terra Scott JD’26

What were your overall thoughts about the AI and the Law class?

“Overall, AI and the Law was an eye-opening class. I didn’t enter law school with a strong background in the legal system (outside of TV), and AI was completely foreign, so signing up for the class was an opportunity I saw to familiarize myself with emerging technology. All too often, the Black community is underrepresented in high-growth tech fields and are sometimes the first to face job displacement due to automation. I wanted to set myself up for success as I prepare for a legal career, especially as AI and technological advancements continue to grow. I went into the class with no specific expectations, only to learn.”

Was there anything interesting or insightful that you discussed that you hadn't thought of before or that was especially memorable?

“I was really shocked by how quickly AI transformed and essentially got smarter throughout the semester. I think the entire class can admit it seemed like every couple of weeks a new model emerged, [with] new features we could explore and more capabilities. It was fun to see the limitations of the large language model (LLM) in January when we first walked in, compared to the end of the semester. 

“I’ll be honest, I used to think AI was the be-all and end-all, but very quickly you realize it's not. There was so much still needed, like verifying that all cited quotes were 100% accurate (which they almost never were), and making sure the inference it relied on was also valid. Since the class existed on a continuum and the memos were just demos, we didn’t always have a solid baseline of knowledge about the information we were asking AI to figure out for us. However, once you understand the question you’re trying to answer, it becomes much easier to see that the answers AI provides are not always spot on. 

“Some of the reasoning was extremely generic and missed the mark. That’s why it’s so important not to rely entirely on the LLM, because doing your own research is still crucial. It made researching much easier — it could help point you in the right direction if you got stuck or needed help finishing a sentence, but it’s nowhere near something I would recommend to a novice as their problem solver. We’re close, but we’re just not there yet.”

Do you feel the class was beneficial to you on your law school journey, and if yes, in what way?

“Absolutely, I have already begun incorporating it into my research methods for my summer internship. However, without this class, I would have never recognized the weaknesses of the LLM. 

“I think everyone has their own way of researching a particular topic or shepherding a case. AI is really good at finding what you may need, but it just doesn’t replace the secondary sources and due diligence of reading the material and having a solid background of knowledge. Without that, you’re doomed to fail. 

“The class was great and a total eye-opener for me, but that is nothing without a great teacher. Professor O’Reilly was extremely knowledgeable about the technology (even though he's humble about it) and took the time to explain not only what AI is, but how it works. That’s so pivotal to understanding the system you’re using. So now, as I look forward to practicing law in this new digital age, I’m comfortable employing these emerging technologies to streamline my research and writing, but even more equipped with the understanding that it should be used carefully and relied on about 35% of the time.”