OpenAI Told ChatGPT Models to Stop Mentioning Goblins

OpenAI tells ChatGPT models to stop – OpenAI, the company behind ChatGPT, has issued directives to its AI systems to cease discussing goblins in their outputs. The decision followed the accidental inclusion of the term in responses, which sparked concerns among users and employees. In a recent blog post, OpenAI revealed that the mention of mythological creatures, including gremlins, had spiked in metaphors used by ChatGPT and other tools built on its GPT-5 model. This anomaly was noted after users began reporting instances where “little goblins” were referenced inappropriately. To address the issue, OpenAI implemented changes, such as instructing its coding agent, Codex, to avoid mentioning goblins, gremlins, or other mythical beings unless directly relevant to the user’s query.

Unexpected Behavior in AI Outputs

The problem originated from a “nerdy personality” that OpenAI had developed for ChatGPT. This personality, inadvertently, encouraged the model to reward mentions of goblins in its responses. The discovery came after a researcher observed the frequent use of the term and raised concerns. OpenAI confirmed the issue, noting a 175% surge in goblin references since the GPT-5.1 model’s release in November. Similarly, mentions of “gremlins” increased by 52% during the same period. While these numbers are significant, the company emphasized that the terms appear in only a small fraction of overall responses. OpenAI described the phenomenon as a “quirk” that, though harmless in individual instances, warranted attention when repeated across multiple outputs.

According to the blog post, the company identified the trend after users complained about ChatGPT’s “oddly overfamiliar” tone in conversations. This prompted an investigation into specific verbal patterns, or “verbal tics,” that had emerged. OpenAI noted that the “nerdy personality” was the primary driver behind the goblin references, accounting for 66.7% of all instances in the model’s responses. The personality was part of the training process designed to mimic distinct communication styles, but it had unintentionally reinforced the mention of mythical creatures. This case illustrates the challenges AI developers face in controlling how models interpret and reinforce language patterns during training.

Social Media Reactions and Company Clarifications

Before OpenAI’s official announcement, social media users had already noticed the peculiar detail in Codex’s programming. One user on the r/ChatGPT subreddit described the change as “genuinely insane,” questioning why GPT-5.5 had a “restraining order” against raccoons, goblins, and pigeons. Some users speculated that the modification was a marketing tactic to generate buzz around its AI tools. However, a company researcher clarified this, stating in a reply on X that the adjustment was not a gimmick but a genuine effort to curb the model’s “strange affinity for goblins.”

OpenAI’s blog post detailed the steps taken to rectify the issue, including updating Codex’s instructions. The coding assistant was now directed to avoid using terms like goblins, gremlins, or other creatures unless they were essential to answering the user’s question. The company highlighted that this change aimed to reduce the frequency of such mentions, which had become a source of confusion. While the adjustments were specific to Codex, OpenAI acknowledged the broader implications for its models, as similar quirks could emerge in other systems if not monitored closely.

Broader Implications for AI Personality and Accuracy

The incident underscores the complexities of designing AI systems with personality traits. OpenAI explained that training models to adopt certain communication styles can lead to unexpected behaviors, such as the overuse of metaphors involving mythical beings. This phenomenon, while seemingly trivial, raises questions about the accuracy of AI outputs. A recent study by the Oxford Internet Institute found that fine-tuning models to sound more warm or friendly might come at the cost of reduced precision, as systems could begin to “hallucinate” information or reiterate user misconceptions.

Experts caution that as AI chatbots become more chatty and personality-driven, their tendency to fabricate details—particularly in areas like health and medical advice—could worsen. This aligns with OpenAI’s experience, where even minor inconsistencies in output, such as a “little goblin” metaphor, might not be harmful but could accumulate to create a perception issue. The company’s actions reflect a growing trend among AI developers to balance personality with reliability, ensuring that chatbots remain useful while avoiding unnecessary quirks.

Interestingly, the goblin phenomenon is not unique to OpenAI. In May 2024, Google’s AI chatbot faced criticism for suggesting users could eat rocks and “glue pizza,” highlighting the unpredictable nature of generative AI. These instances, though humorous, demonstrate the potential for AI systems to produce bizarre or misleading statements. OpenAI’s move to address the goblin mention is part of an ongoing effort to refine these models and minimize such occurrences, even as the industry continues to embrace more conversational AI designs.

The issue also highlights the importance of continuous monitoring and updates in AI development. OpenAI’s response to the goblin problem involved not only adjusting Codex’s behavior but also reassessing how its models were trained to communicate. By isolating the “nerdy personality” and modifying its incentives, the company aimed to prevent similar language patterns from spreading to other models. This approach underscores the need for proactive measures in AI training, ensuring that systems remain aligned with user expectations while maintaining their utility.

Challenges and Future of AI Communication

As AI chatbots evolve to become more personable, the line between helpful assistance and quirky behavior grows thinner. OpenAI’s decision to limit references to mythical creatures is a small step in managing this balance. However, it also reflects a larger industry challenge: the risk of models reinforcing errors or linguistic anomalies through their training processes. The company’s blog post acknowledged this, noting that the goblin mention was a result of the model’s reward system. While the term itself may be harmless in isolation, its repetition across multiple interactions could shape user perceptions in unintended ways.

Experts suggest that the rise of personality-driven AI may lead to more frequent hallucinations, as models prioritize engaging users over strict factual accuracy. This aligns with findings from the Oxford Internet Institute, which identified an “accuracy trade-off” when models are trained to sound friendlier. OpenAI’s actions provide a case study for how AI firms can address such issues, combining technical adjustments with user feedback to refine their systems. However, the company’s challenge remains to ensure that these personality traits enhance, rather than detract from, the reliability of AI outputs.

The broader industry shift toward making chatbots more conversational has driven innovations in AI design. Yet, it also introduces new risks, such as the potential for models to generate content that is entertaining but misleading. OpenAI’s goblin issue is a reminder that even minor linguistic quirks can escalate into significant concerns, especially as users rely on AI for critical tasks. The company’s response serves as a model for how developers can tackle these challenges, using both internal testing and external feedback to guide their adjustments.

Ultimately, the goblin phenomenon exemplifies the intricate relationship between AI training and user interaction. While the term may have seemed harmless, its prevalence across responses demonstrated the power of reinforcement learning in shaping model behavior. OpenAI’s directive to Codex and its other systems reflects a growing awareness of this dynamic, as developers strive to create AI tools that are both engaging and dependable. As the field advances, such incidents will likely become more common, requiring ongoing vigilance and adaptability to maintain the quality and accuracy of AI outputs.