Google has removed Gemma, an AI model from its AI Studio platform, following a complaint from Republican Senator Marsha Blackburn, who claims the model generated false accusations of sexual misconduct against her.
Senator Blackburn wrote a letter to Google CEO Sundar Pichai, claiming that she became aware of Gemma producing false allegations about her after attending a hearing where she was accused of rape by an AI bot. According to her letter, Gemma allegedly produced a fabricated story about her having a non-consensual affair with a state trooper.
Google has announced that it will no longer allow users to access the model through its platform, citing concerns over "non-developers" manipulating the AI model to produce inflammatory outputs. However, developers can continue to use the model via the API and download the model for local development purposes.
The move comes amid a broader push by some lawmakers to regulate and restrict the use of AI models that generate false or misleading information. The incident has sparked debate about the role of technology companies in policing their own products and preventing potential misuse.
Google's decision to remove Gemma from its platform may be seen as an effort to avoid further controversy, particularly given the company's ongoing antitrust lawsuits and criticism over its handling of conservative voices on social media platforms.
Senator Blackburn wrote a letter to Google CEO Sundar Pichai, claiming that she became aware of Gemma producing false allegations about her after attending a hearing where she was accused of rape by an AI bot. According to her letter, Gemma allegedly produced a fabricated story about her having a non-consensual affair with a state trooper.
Google has announced that it will no longer allow users to access the model through its platform, citing concerns over "non-developers" manipulating the AI model to produce inflammatory outputs. However, developers can continue to use the model via the API and download the model for local development purposes.
The move comes amid a broader push by some lawmakers to regulate and restrict the use of AI models that generate false or misleading information. The incident has sparked debate about the role of technology companies in policing their own products and preventing potential misuse.
Google's decision to remove Gemma from its platform may be seen as an effort to avoid further controversy, particularly given the company's ongoing antitrust lawsuits and criticism over its handling of conservative voices on social media platforms.