A Microsoft software engineer, Shane Jones, has raised concerns about the company's AI image generator, Copilot Designer, in a letter sent to the US Federal Trade Commission. Jones claims that the tool frequently produces offensive or inappropriate images, including sexualized images of women, despite being marketed as safe, even for children. He also criticized Microsoft for not disclosing known risks associated with the tool. Jones, who works on testing Microsoft's products for vulnerabilities, found more than 200 concerning images created by Copilot Designer and has urged the company to remove the tool from public use or market it only to adults.

Jones's letter comes amid growing concerns about AI image generators spreading offensive or misleading images, such as the recent incident of AI-generated pornographic images of Taylor Swift. He also called on Microsoft's board of directors to conduct investigations into the company's decision to continue marketing AI products with public safety risks and to improve responsible AI reporting and training processes. Jones also raised concerns about vulnerabilities in OpenAI's DALL-E 3, the technology behind Copilot Designer, that could allow users to create disturbing and violent images.

In his testing of Copilot Designer, Jones found images depicting demons, monsters, sexualized violence, and underage drinking and drug use, which he recreated using the tool for CNBC. He described the experience as eye-opening and emphasized the need for better safeguards in AI models. Microsoft and OpenAI have not yet responded to Jones's claims, and the FTC declined to comment on the letter. Jones has also raised his concerns with Washington Attorney General Bob Ferguson and lawmakers, including the US Senate Committee on Commerce, Science, and Transportation.