Federal Agency Leverages AI Tool to Draft Safety Rules, Staffers Raise Concerns
The US Department of Transportation (DOT) is using artificial intelligence to draft safety rules for various transportation systems, including airplanes, cars, and pipelines. The use of AI in rulemaking has sparked concerns among staff members, who fear that flawed laws could lead to injuries or even deaths.
According to a report by ProPublica, the DOT's top lawyer, Gregory Zerzan, believes that the goal is not to create perfect rules but to speed up the process and get "good enough" rules on the table within 30 days. The agency's preferred tool for this purpose is Google's Gemini AI system.
However, some staff members are deeply skeptical about using AI to draft safety rules, citing concerns over the accuracy and reliability of such systems. They point out that AI can confidently produce incorrect information and hallucinate fabricated details, which could have serious consequences in transportation safety.
One staffer compared the task of drafting regulations to "word salad," suggesting that Gemini can help with this aspect but may not be able to fully grasp the intricacies of the subject matter. Additionally, a demonstration of Gemini's rule-drafting capabilities produced a document missing key text, which would need to be filled in by human staff members.
Experts who monitor AI use in government have expressed concerns about the potential risks and consequences of relying on such systems for critical tasks like safety regulation. While some see the potential benefits of using AI as a research assistant with proper supervision and transparency, others are worried that this approach could compromise safety.
The issue has sparked debate within the agency, with some staff members voicing concerns about the lack of oversight and the potential consequences of relying on flawed rules. One staffer described the use of AI to draft safety rules as "wildly irresponsible."
It remains to be seen how the DOT will address these concerns and balance the benefits of using AI in rulemaking with the need for human oversight and expertise.
The US Department of Transportation (DOT) is using artificial intelligence to draft safety rules for various transportation systems, including airplanes, cars, and pipelines. The use of AI in rulemaking has sparked concerns among staff members, who fear that flawed laws could lead to injuries or even deaths.
According to a report by ProPublica, the DOT's top lawyer, Gregory Zerzan, believes that the goal is not to create perfect rules but to speed up the process and get "good enough" rules on the table within 30 days. The agency's preferred tool for this purpose is Google's Gemini AI system.
However, some staff members are deeply skeptical about using AI to draft safety rules, citing concerns over the accuracy and reliability of such systems. They point out that AI can confidently produce incorrect information and hallucinate fabricated details, which could have serious consequences in transportation safety.
One staffer compared the task of drafting regulations to "word salad," suggesting that Gemini can help with this aspect but may not be able to fully grasp the intricacies of the subject matter. Additionally, a demonstration of Gemini's rule-drafting capabilities produced a document missing key text, which would need to be filled in by human staff members.
Experts who monitor AI use in government have expressed concerns about the potential risks and consequences of relying on such systems for critical tasks like safety regulation. While some see the potential benefits of using AI as a research assistant with proper supervision and transparency, others are worried that this approach could compromise safety.
The issue has sparked debate within the agency, with some staff members voicing concerns about the lack of oversight and the potential consequences of relying on flawed rules. One staffer described the use of AI to draft safety rules as "wildly irresponsible."
It remains to be seen how the DOT will address these concerns and balance the benefits of using AI in rulemaking with the need for human oversight and expertise.