Posts

Showing posts with the label AI hallucinations

Beware the “Hallmarks” of AI: Recent GAO Decision Provides Cautionary Tale for Protesters

For better or worse, artificial intelligence (AI) is transforming the legal industry. The Government Accountability Office’s (GAO) recently decided  Bramstedt Surgical Inc. [1] , dedicating three pages to warnings about penalties it could have imposed on the protester and protester’s counsel for incorrect citations . For those tracking GAO’s recent handling of protesters and lawyers who file documents that appear to be riddled with AI-hallucinated citations or legal arguments citing to cases that do not stand for the premise alluded to, the decision comes as no surprise. Nevertheless, the  Bramstedt  decision serves as a stark reminder that while AI can be a useful tool, it can also create serious professional and legal exposure when used without proper oversight .  In this blog, we will explain why GAO’s decision should be a wake-up call for government contractors relying on AI for their protests , identify key risks protesters need to understand before using AI, a...

AI Hallucinations Could Cause Nightmares for Your Business: 10 Steps You Can Take to Safeguard Your GenAI Use

Image
  Consider the following real-life scenarios: An airline’s AI-powered  chatbot  promises a customer that it could provide a steep discount for a bereavement flight – a promise that goes directly against company policy. A court later ruled that the airline had to honor the promise. A researcher  gathering background information  on a prominent professor discovers evidence that the professor had been accused of making sexually suggestive comments and attempting to inappropriately touch a student – but it turns out that ChatGPT invented both the story and the citations to it. HR uses AI to develop a  job description  for an entry-level role but didn’t read it closely enough before posting it. After no one applied, the HR reps discover that the opening required candidates to have five to seven years of experience. The Chicago Sun-Times and Philadelphia Inquirer (and others) publish a  syndicated summer reading list  to guide readers about th...